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CHAPTER  I 


INTRODUCTION 

Background:  Electronics,  Computers, 

Technology ,  and  Automatic 
Test  Equipment 

The  Air  Force’s  heavy  reliance  on  electronics  in 
almost  every  primary  and  support  mission  area  dictates  a 
need  for  effective  acquisition  of  electronics  equipment. 
Since  approximately  a  third  of  the  total  value  of  Air  Force 
weapons  and  equipment  represents  electronics,  an  effective 
electronics  equipment  acquisition  program  is  further  justi¬ 
fied  (24:38).  In  addition,  the  total  fiscal  1982  requested 
funding  of  $270  million  for  electronics  research,  develop¬ 
ment,  test  and  evaluation  (which  is  more  money  than 
requested  for  research,  development,  test  and  evaluation 
of  weaponry,  flight  vehicles,  or  propulsion  and  power) 
underscores  the  importance  of  effective  electronics  equip¬ 
ment  acquisition  in  the  Air  Force  (24:38). 

One  of  the  largest  applications  of  electronics  in 
the  Air  Force  is  the  computer.  In  today's  world  of  high 
technology,  computers  are  playing  an  ever-increasing  role 
of  importance.  Within  the  Department  of  Defense  (DOD) , 
the  highly  complex  role  of  the  military  requires 
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increasing  use  of  computers  to  do  the  job  of  defense  more 
efficiently  (42:1-F)  . 

The  United  States  is  entering  a  period  of  military 
buildup  aimed  at  improving  electronics  and  computer  capa¬ 
bilities.  President  Reagan  promises  to  counter  Soviet 
military  might  through  an  accelerated  five-year  defense 
spending  program  that  will  have  an  increasing  portion  of 
the  budget  dedicated  to  new  technologies  in  electronics 
(11:88) . 

One  of  these  new  technologies  is  the  F-16  fighter 
aircraft,  currently  in  the  deployment  stage  of  the  acquisi¬ 
tion  cycle  (29)  .  The  F-16  is  a  highly  technical,  computer¬ 
ized  aircraft  that  is  designed  to  accomplish  one  part  of 
the  defense  mission.  The  Air  Force  has  three  continental 
United  States  (CONUS)  bases  at  which  the  F-16  aircraft  is 
assigned.  Each  base/wing  has  a  squadron,  or  multiple 
squadrons,  of  F-16  aircraft  assigned  to  an  operational 
role.  It  is  imperative  that  these  aircraft  be  kept  in 
the  highest  possible  state  of  readiness. 

While  the  F-16  aircraft  illustrates  the  applica¬ 
tion  of  new  technology  in  the  primary  mission  area  of  the 
Air  Force,  the  combination  of  electronics  and  computers 
in  the  support  mission  area  is  exemplified  by  automatic 
test  equipment  (ATE) .  Automatic  test  equipment  is  defined 
as 
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.  .  .  equipment  which  carries  out  a  predetermined 
program  of  testing  for  possible  malfunction  without 
reliance  upon  human  intervention.  .  .  .  ATE  is  a 
generic  term  for  equipment  (separate  or  built  in) 
satisficing  a  test  function  (diagnostic  or  condition 
indicating)  and  possessing  an  automatic  capability. 

In  this  sense,  ATE  can  be  either  a  part  of  the  mission 
equipment  or  a  part  of  SE  [37:80] . 

Although  the  number  of  electronics  systems  (including  ATE) 

and  associated  expenditure  of  funds  are  noteworthy. 

General  Marsh,  Commander  of  Air  Force  Systems  Command, 

states  that  the  toughest  challenges  in  the  Air  Force's 

electronics  future  are,  in  fact,  managerial  (24:38).  As 

such,  support  equipment  (SE) ,  of  which  ATE  is  a  major 

part,  was  identified  as  one  of  the  key  elements  to  be 

managed  in  the  integrated  logistics  support  (ILS)  system 

(7:206).  The  DOD  states  that 

Integrated  logistics  support  is  a  unified  and 
iterative  approach  to  the  management  and  technical 
activities  necessary  to:  (a)  cause  support  considera¬ 
tions  to  influence  requirements  and  design;  (b)  define 
each  other;  (c)  acquire  the  required  support;  and 
(d)  provide  the  required  support  during  the  opera¬ 
tional  phase  at  minimum  cost  [7:201]. 

The  purpose  of  the  SE  element  of  ILS  is  to  ensure 
that  the  required  equipment  is  available  to  operating, 
maintenance,  and  training  activities  when  needed. 

The  ability  of  an  activity  to  perform  required 
maintenance  depends  on  the  availability  and  perform¬ 
ance  of  the  SE  identified  or  developed  for  the  prime 
system  and  equipment  [7:206]. 

Thus,  the  increasing  number  of  electronics  and 
computer  systems  in  the  Air  Force,  the  managerial  issues 
raised  by  senior  Air  Force  leadership,  and  the 
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identification  of  SE  (and  its  subset,  ATE)  as  a  key 
element  of  integrated  logistics  support  all  point  to  the 
need  for  an  effective  and  efficient  decision-making  system 
to  use  when  procuring  automatic  test  equipment. 

In  particular,  one  of  the  prime  factors  in  main¬ 
taining  a  high  state  of  readiness  of  the  F-16  is  main¬ 
tenance  of  the  aircraft  and  its  support  systems.  As  the 
F-16  was  developed  and  produced,  automatic  test  equipment 
(ATE)  was  also  developed  and  produced  to  test  and  diagnose 
line  replaceable  unit  (LRU)  malfunctions.  The  ATE  for  the 
F-16  includes  avionics  stations  for  four  of  the  major 
subsystems  on  the  aircraft:  radio- frequency  (RF) ,  pneu¬ 
matic  processor  (PP) ,  computers/ inertial  (Cl),  and  display/ 
indicators  (DI)  (see  Figure  1)  (16).  Of  the  four  subsys¬ 
tems  listed,  the  RF  subsystem  has  historically  experienced 
the  most  failures  (31)  .  Figure  2  shows  the  Avionics 
Intermediate  Shop  (AIS)  RF  test  station  used  to  perform 
intermediate  level  test  and  repair  on  F-16  RF  LRUs 
(17:1-0) . 

One  area  of  concern  during  the  acquisition  of  the 
weapon  system  and  associated  support  equipment  is  the 
number  of  Avionics  Intermediate  Shop  (AIS)  test  sets  that 
are  required  to  maintain  the  aircraft  systems.  Such  con¬ 
cern  manifests  itself  in  the  complex  interrelationships 
between  the  costs  and  benefits  of  buying  additional  support 
equipment  (SE)  or  spares.  Essentially,  the  support 
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Fig.  1.  The  Four  Types  of  Test  Stations 


Fig.  2.  The  F-16  AIS  RF  Test  Station 


equipment  acquisition  decision  is  reduced  to  a  tradeoff 
between  the  cost  of  an  additional  test  set  and  the  bene¬ 
fits  obtained. 

When  buying  a  new  weapon  system  and  associated 
support  equipment,  a  request  for  proposal  (RFP)  is  nor¬ 
mally  written.  The  RFP  usually  contains  explicit  design 
or  performance  specifications  (29) . 

When  the  F-16  was  early  in  the  acquisition  cycle, 
it  was  decided  that  the  requirement  for  support  equipment 
would  be  included  in  the  RFP  for  the  complete  weapon  sys¬ 
tem.  A  RFP  for  the  AIS-ATE  was  not  prepared  by  the  Air 
Force  (5:4-5?  6).  Instead,  a  support  equipment  require¬ 
ments  document  was  developed  which  tasked  the  F-16  con¬ 
tractor,  General  Dynamics-Fort  Worth,  to  develop  a  RFP  for 
F-16  support  equipment.  As  a  result  of  a  F-16  trade  study 
and  proposals  from  several  vendors,  the  current  AIS-ATE 
configuration  was  recommended  by  General  Dynamics  and 
approved  by  the  Air  Force. 

After  the  AIS-ATE  configuration  was  approved,  the 
question  of  how  many  AIS  test  sets  to  procure  was  addressed. 
A  F-lll  test  set  utilization  model  was  modified  and  used 
to  determine  AIS  test  set  quantities  to  support  the  F-16. 
Model  parameters  were  estimated  by  engineering  studies 
based  on  predicted  failure  rates  and  service  times  (35) . 
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F-16  Maintenance  Concepts:  Organizational, 
Intermediate,  Depot 

The  F-16  is  supported  by  a  three-level  maintenance 
concept  consisting  of  organizational  intermediate,  and 
depot  as  shown  in  Figure  3  (17;  40;  41). 

Organizational  level  maintenance  is  accomplished 
on  a  flight  line  and  consists  of  fault  isolation,  removal, 
and  replacement  of  faulty  LRUs.  Intermediate  level  main¬ 
tenance  is  at  the  AIS  and  consists  of  testing,  trouble¬ 
shooting,  and  repair  of  LRUs  using  the  automated  test 
sets.  The  LRUs  that  are  not,  or  cannot  be,  repaired  at 
the  intermediate  level  are  evacuated  to  depot  and  are 
repaired,  condemned,  or  salvaged. 

The  basic  component  of  repair  of  the  F-16,  then, 
is  the  LRU  which  is  defined  as 

.  .  .  an  item  that  is  normally  removed  and  replaced 
as  a  single  unit  to  correct  a  deficiency  or  malfunction 
on  a  weapon  or  support  system  and  item  of  equipment. 
Such  items  have  a  distinctive  stock  number  for  which 
spares  are  locally  authorized  to  support  the  removal 
and  replacement  action  [37:393]. 

A  LRU  may  also  be 

.  .  .  any  assembly  which  can  be  removed  as  a  unit 
from  the  system  at  the  operating  location.  This  may 
include  avionics,  hydraulics,  pneumatics,  and  other 
recoverable  parts  [37:393]. 

Since  maintenance  becomes  part  of  the  pipeline 
for  serviceable  spares  (4  :16  5-19  5;  25;  38 :pp. 5-1  to  5-8 , 

9-1  to  9-33),  the  time  spent  in  maintenance  will  be  a 

driving  factor  in  determining  not  only  the  number  of 
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spares  to  buy,  but  how  many  test  stations  are  needed  to 
efficiently  move  the  repairable  LRUs  through  maintenance. 

Maintenance  can,  therefore,  be  viewed  as  a  system 
of  queues,  or  waiting  lines,  in  front  of  servers.  This 
view  of  maintenance  suggests  that  one  significant  factor 
in  deciding  how  many  test  sets  to  buy  is  waiting  time  in 
the  queue. 

If  waiting  time  can  be  significantly  reduced  with 
additional  test  sets  available,  then  that  number  of  test  sets 
should  become  part  of  the  total  weapon  system  acquisition. 

Problem  Statement;  Determining  Support 
Equipment  Requirements 

The  final  decision  to  procure  two  AIS  test  sets  for 
each  group  of  72  F-16  aircraft  and  additional  test  sets  for 
the  depot  appears  to  have  been  determined  by  using  a  modi¬ 
fied  F-lll  test  set  utilization  model.  Apparently  there 
were  no  unique  F-16  models  of  real  world  operational  data 
used  to  calculate  the  number  of  ATE-aIS  sets  that  would  be 
needed  to  support  the  F-16  program  because  the  support 
equipment  decision  was  made  before  the  data  was  available. 
The  F-16  SPO  director  for  AIS  acquisition  logistics, 

Cslonel  John  K.  Rutledge,  stated  that  the  use  of  a  support 
equipment  decision  model  using  real  world  documented  data 
would  now  be  appropriate  (35) .  In  addition,  the  develop¬ 
ment  of  a  unique  F-16  model  for  test  set  determination  and 
a  comparison  of  its  results  against  the  modified  F-lll 
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model  used  to  make  the  test  set  quantity  decision  could 
prove  valuable. 

Many  quantitative  techniques  or  models  could  be 
used  to  assist  decision  makers  in  determining  the  amount 
of  support  equipment  (SE)  required  to  support  a  new  weapon 
system  (1;  2;  4;  8;  21;  25;  32;  36;  39).  In  particular, 
queueing  theory  has  been  shown  to  be  a  valuable  quantita¬ 
tive  tool  in  the  evaluation  of  the  repair  cycle  for  weapon 
systems  and  equipment  (1:598-623;  8:245-261;  32 :VII-X, 18 ) . 

Queueing,  or  waiting  line,  situations  arise  when¬ 
ever  arrivals  at  a  service  activity  desire  similar  ser¬ 
vices  or  the  same  server.  Within  the  repair  cycle  of  the 
F-16  LRUs,  arrivals  can  be  generated  by  the  failure  rate 
of  the  LRU  and  service  can  be  represented  by  the  time  to 
test  and/or  repair  the  LRU.  Figure  4  shows  the  framework 
for  viewing  waiting  line  situations  (8 :2s 7).  Figure  5 
shows  the  F-16  LRU  repair  cycle  process  as  depicted  within 
the  waiting  line  situation  framework  of  Figure  4 . 


Fig.  5.  F-16  System  Maintenance  Repair  Cycle 


The  F-16  repair  cycle  can  be  viewed  as  a  waiting 
line  problem  in  which  LRUs  fail  and  subsequently  arrive 
at  the  AIS  for  service.  Service  is  then  performed  using 
the  ATE-AIS  equipment.  Queueing  models  have  been  devel¬ 
oped  which  provide  information  regarding  waiting  time, 
idle  time,  number  of  LRUs  waiting,  and  other  system 
operating  characteristics  (1:617).  Inherent  in  queueing 
theory  is  a  system  of  arrivals,  queues,  servers,  and  exit 
from,  or  return  to,  the  system.  Thus,  the  use  of  a  sys¬ 
tems  approach,  such  as  the  system  science  paradigm,  is  an 
appropriate  methodology  when  considering  waiting  line 
problems  as  in  the  F-16  LRU  repair  cycle  (9?  33). 

The  system  science  paradigm  has  been  advocated  as 
a  methodology  to  use  when  undertaking  a  systems  analysis 
of  an  organization  (36:295).  The  methodology  of  the  sys¬ 
tem  science  paradigm  consists  of  the  steps:  (1)  conceptuali¬ 
zation,  (2)  analysis  and  measurement,  and  (3)  computeriza¬ 
tion  (36:296).  The  system  science  paradigm,  then,  provides 
a  way  of  thinking  for  problem  solvers  to  use  when  ana¬ 
lyzing  complex  systems.  It  provides  a  framework  in  which 
the  researcher  can  organize  a  scientific  approach  to  system 
problem  solving.  When  using  the  system  science  paradigm, 
it  is  important  to  identify  the  elements  and  their  inter¬ 
relationships  within  the  system.  In  a  queueing  situation 
the  major  elements  are  arrivals,  queues,  and  servers. 
Therefore,  it  is  important  to  characterize  the  arrival  and 
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server  random  variables.  In  the  F-16  LRU  repair  cycle, 
arrivals  of  the  failed  LRUs  can  be  characterized  by  the 
failure  rate  probability  distribution  of  the  LRUs  and 
service  can  be  characterized  by  the  time  to  test  and/or 
time  to  repair  probability  distributions  of  the  LRUs. 
Additionally,  average  waiting  time  for  service  is  con¬ 
sidered  to  be  an  important  queueing  system  characteristic 
(1:598-599;  18). 

Although  there  are  numerous  factors  that  could  be 
used  to  determine  the  number  of  test  sets  needed  to  sup¬ 
port  the  F-16  (e.g.,  test  set  utilization  (4:167-168), 
sortie  rates  (23:4),  cost-benefit  analysis  (2:292-285;  14)), 
queueing  theory  allows  average  waiting  time  for  test  or 
repair  to  be  characterized.  Average  waiting  time  can 
therefore  be  considered  a  reasonable  driver  that  will 
determine  the  appropriate  number  of  test  sets  because  a 
change  in  the  number  of  test  sets  will  affect  the  service 
activity. 

Also,  a  F-16  LRU  can  be  in  several  states  of 
serviceability.  First,  it  can  be  serviceable  either 
installed  on  the  end  item,  in  transit,  or  in  stock. 

Second,  it  can  be  in  an  unserviceable  condition  either 
awaiting  maintenance,  in  transit,  or  in  maintenance.  Of 
all  these  conditions,  the  least  acceptable  is  awaiting 
maintenance  because  it  represents  an  asset  that  is  not 
useable  and  no  action  is  being  taken  to  restore  it  to  a 
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useable  condition.  In  addition,  the  practical  limitations 
imposed  by  the  current  F-16  data  collection  system  directed 
the  effort  to  an  examination  of  the  problem  within  the 
framework  of  waiting  line  modeling. 

In  sum,  theoretical  queueing  models.  Air  Force 
asset  policy  and  real  world  data  limitations  all  tend  to 
focus  on  average  waiting  time  as  a  critical  variable  when 
making  support  equipment  procurement  decisions. 

Thus,  if  a  model  can  be  developed  which  will  allow 
determination  of  waiting  time  in  the  AIS,  then,  by  varying 
the  number  of  test  sets,  the  impact  on  waiting  time  can 
be  ascertained.  As  a  result,  a  "satisficing"  number  of 
test  sets  can  be  found  that  will  significantly  reduce 
waiting  time  in  the  AIS. 

The  "satisficing"  view  of  decision  making  is  "an 
attempt  to  move  closer  to  reality  and  to  understand  the 
world  as  it  actually  is  [21:65]."  Simon  summarized  the 
main  assumptions  of  the  theory  of  satisficing  by  stating 
that: 


In  the  real  world  we  usually  do  not  have  a  choice 
between  satisfactory  and  optimal  solutions,  for  we 
only  rarely  have  a  method  of  finding  the  optimum. 

.  .  .  We  cannot,  within  practical  computational 
limits,  generate  all  the  admissible  alternatives  and 
compare  their  relative  merits.  Nor  can  we  recognize 
the  best  alternative,  even  if  we  are  fortunate  to 
generate  it  early,  until  we  have  seen  all  of  them. 

We  satisfice  by  looking  for  alternatives  in  such  a  way 
that  we  can  generally  find  an  acceptable  one  after 
only  moderate  search  [21:66]. 
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Since  maintenance  becomes  part  of  the  pipeline 
for  serviceable  spares,  the  time  spent  awaiting  maintenance 
will  be  a  driving  factor  in  determining  not  only  the  number 
of  spares  to  buy,  but  also  how  many  test  stations  are 
needed  to  efficiently  move  the  reparable  LRUs  through  main¬ 
tenance.  Figure  5  shows  the  overall  repair  cycle  for  the 
F-16  LRUs,  and  is  the  basic  building  block  of  the  struc¬ 
tural  model  that  will  be  used  in  modeling  waiting  time  (31) . 

If  waiting  time  can  be  statistically  signifi¬ 
cantly  reduced  with  additional  test  stations,  then  that 
number  of  test  stations  should  be  considered  as  a  basis 
for  beginning  the  decision  process.  The  ultimate  decision 
must  be  made  within  the  framework  of  the  decision  maker's 
knowledge  and  experience  coupled  with  the  organizational 
reality  of  the  decision  setting. 

In  order  to  develop  a  quantitative  decision  support 
system  (DSS) ,  a  data  collection  system  that  will  provide 
raw  data  showing  maintenance  test  times,  actual  maintenance 
times,  and  failure  rates  of  the  LRUs  is  needed.  This  data 
is  necessary  so  that  the  failure  rate  parameters  and  proba¬ 
bility  density  functions  for  time  to  test  and  time  to 
repair  the  LRU  can  be  ascertained. 

The  Dynamics  Research  Corporation  (DRC)  has  pro¬ 
vided  such  a  system,  called  the  Centralized  Data  System 
(CDS),  for  the  F-16  (13:p.l-l).  The  CDS  collects  data  on 
a  real-time  basis  from  each  maintenance  activity  and 
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stores  the  data  in  a  centralized  computer.  The  stored 
data  can  be  accessed  by  any  user  in  the  network.  Data 
collection  techniques,  and  the  CDS  network,  are  discussed 
in  more  detail  in  Chapter  II  (13:2-6). 

Theory  Postulation 

In  order  to  determine  if  a  significant  reduction 
in  AIS  waiting  time  has  occurred  when  an  additional  test 
station  is  added,  statistical  comparative  techniques  must 
be  used  (10:40-69;  20:220-240,305-310;  26:459-524).  The 
results  of  any  model  must  be  statistically- tested  and 
analyzed  to  determine  if,  within  a  given  confidence 
level,  a  significant  change  in  the  response  surface  has 
occurred  when  different  treatments  are  applied.  Practical 
significance  must  also  be  considered  when  making  the  final 
decision. 

Research  Question  #1:  Character¬ 
ization  of  Arrival  and  Service 
Random  Variables 

The  arrival  and  service  random  variables  will  be 
used  as  inputs  into  the  queueing  system  model  of  the 
F-16  LRU  repair  cycle.  The  arrival  rate  random  variable 
can  be  described  by  the  failure  rate  of  the  LRU.  That  is, 
as  LRUs  fail,  they  arrive  at  the  Avionics  Intermediate 
Shop  for  service.  Service,  on  the  other  hand,  can  occur 
at  the  AIS  in  one  of  two  ways.  First,  service  can  be  per¬ 
formed  by  testing  the  LRU  in  order  to  isolate  the  reported 
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failure.  In  some  cases  no  failure  will  be  detected  and 
the  entire  service  time  will  consist  of  the  time  to  test 
the  LRU.  Second,  service  can  be  performed  by  testing  and 
repairing  the  LRU.  In  this  case,  a  failure  was  detected 
during  testing  of  the  LRU  and  was  subsequently  repaired. 
Thus  the  service  random  variable  can  be  described  by  the 
time  to  test  and  time  to  repair  random  variables  of  the 
F-16  LRU  repair  cycle.  Therefore,  the  first  research 
question  is:  can  probability  distributions  and  descrip¬ 
tive  parameters  for  failure  rates,  time  to  test,  and  time 
to  repair  random  variables  for  a  selected  F-16  LRU  be 
estimated  and  used  as  inputs  to  the  queueing  simulation 
model? 

Research  Question  #2:  Relationship 
Between  AIS  Test  Sets  and  LRU 
Waiting  Time 

While  research  question  #1  dealt  with  the  inputs 
into  the  queueing  model  of  the  F-16  LRU  repair  cycle, 
research  question  #2  postulates  a  theory  about  the  outputs 
of  the  model.  When  a  LRU  arrives  at  the  AIS  for  service, 
the  LRU  may  immediately  move  into  the  server,  or  the  LRU 
may  have  to  wait  for  service.  The  capability  of  a  LRU  to 
be  immediately  served  or  having  to  wait  for  service 
depends  upon  the  availability  of  the  server.  The  server 
consists  of  both  the  personnel  performing  the  service  and 
the  equipment  which  is  being  used  to  perform  the  service. 
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In  the  F-16  LRU  repair  cycle,  the  server's  equipment  is 
automatic  test  equipment.  Assuming  that  the  people  are 
available,  the  only  time  that  a  LRU  would  be  required  to 
wait  for  service  would  be  when  the  automatic  test  equip¬ 
ment  was  not  available.  ATE  could  be  unavailable  due  to 
one  of  two  reasons.  First,  the  ATE  could  be  in  use 
servicing  another  LRU.  Second,  the  ATE  could  be  inoper¬ 
able.  Since  the  operational  availability  rate  of  the  ATE 
has  historically  been  high  (31),  it  is  assumed  that  the 
LRU  will  wait  for  service  only  when  the  ATE  is  being  used 
to  service  another  LRU.  Thus,  there  appears  to  be  a  rela¬ 
tionship  between  the  number  of  AIS  test  sets  and  the  time 
that  a  LRU  spends  awaiting  maintenance.  Therefore,  the 
second  research  question  is:  can  the  effect  of  the  number 
of  AIS  test  sets  on  LRU  waiting  maintenance  time  be 
ascertained  by  using  a  queueing  simulation  model  of  the 
F-16  LRU  repair  cycle?  Furthermore,  does  a  relationship 
between  the  number  of  AIS  test  sets  and  LRU  awaiting  main¬ 
tenance  time  exist?  In  other  words,  is  the  average  wait¬ 
ing  time  of  a  LRU  in  the  AIS  independent  of  the  number  of 
AIS  test  sets?  If  the  answer  to  this  question  is  affirma¬ 
tive,  procurement  of  more  than  one  AIS  test  set  to  main¬ 
tain  F-16  LRUs  will  not  significantly  reduce  LRU  awaiting 
maintenance  time. 
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Research  Question  #3:  The  Practical 
Significance  Issue 

Research  question  #1  theorized  that  model  inputs 
could  be  characterized  and  described.  Research  question 
#2  hypothesized  that  the  outputs  of  the  model  could  be 
used  to  determine  the  relationship  between  the  number  of 
AIS  test  sets  and  LRU  waiting  time.  Research  question  #3 
deals  with  the  evaluation  of  the  model  outputs  by  the 
decision  maker.  While  the  queueing  model  acts  as  a  quanti¬ 
tative  decision  aid,  it  must  be  remembered  that  the  model 
is  a  decision  support  system,  not  a  decision  making  sys- 
stem  (15) .  Thus,  the  interface  between  the  model  and  the 
decision  maker  becomes  important  and  the  issue  of  the 
decision  maker's  practical  significance  arises.  Therefore, 
the  third  research  question  is:  should  the  practical  sig¬ 
nificance  of  the  change  in  average  LRU  waiting  time  due 
to  the  change  in  the  number  of  test  sets  be  evaluated  in 
addition  to  the  statistical  significance  analysis  of 
research  question  #2? 


Summary 

Three  research  questions  were  constructed  to  study 
the  intermediate  maintenance  process  of  the  F-16  aircraft. 
The  first  research  question  hypothesizes  that  arrival  and 
service  random  variables  can  be  described.  The  second 
research  question  is  a  theory  that  the  relationship  between 
AIS  test  sets  and  LRU  awaiting  maintenance  time  can  be 
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ascertained.  The  third  research  question  is  a  theory  on 
the  use  of  the  decision  support  system  by  the  decision 
maker.  A  correlation  of  the  problem  statement  and  the 
research  questions  is  summarized  in  Table  1. 


TABLE  1 

CORRELATION  OF  PROBLEM  STATEMENTS  AND 
RESEARCH  QUESTIONS 


Problem  Statement  Research  Question 

1.  Queueing  theory  critical  1.  Can  arrival  and  service 

items  are  arrival,  probability  density 

service  functions  be  estimated? 

2.  Average  time  in  the  queue  2.  Is  average  wait  in  the 

is  a  reasonable  driver  to  queue  independent  of 

determine  appropriate  number  number  of  test  sets? 
of  test  sets 

Effect  of  increase  in  number 
of  test  sets  on  waiting  time 
is  unknown 

3.  Practical  evaluation  must  3.  Are  practical  signifi- 

be  added  to  quantitative  cance  and  statistical 

techniques  in  decision  significance  related? 

process 
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CHAPTER  II 


RESEARCH  METHODOLOGY 

Introduction 

The  Queueing  System 

Although  the  LRU  is  the  building  block  of  the 
modeling  process,  an  analytical  approach  will  not  be  used 
to  simulate  the  repair  cycle  process  of  the  F-16.  Such 
an  approach  would  be  too  limited  and  would  fail  to  include 
important  elements  and  relationships  involved  in  the  com¬ 
plete  repair  cycle  (9;  33;  39:36-40) . 

In  fact,  it  will  be  necessary  to  model  more  than 
just  the  testing  and  repair  of  the  LRU  in  order  to  capture 
all  the  elements  and  relationships  necessary  to  depict  the 
"real  world"  repair  cycle  of  the  F-16,  as  depicted  in 
Figures  3  and  5.  Therefore,  a  systems  approach  to  model¬ 
ing  the  F-16  LRU  repair  cycle  must  be  undertaken. 

The  particular  systems  approach  to  be  taken  will 
be  that  of  the  system  science  paradigm,  which  consists  of 
the  three  steps  of  conceptualization,  analysis  and  measure¬ 
ment,  and  computerization  (36:295-305).  In  order  to  use 
the  system  science  paradigm,  it  is  necessary  to  identify 
a  modeling  approach  that  can  be  used  to  most  closely 
approximate  the  F-16  LRU  repair  cycle  (36:295-305). 
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Several  studies  have  shown  that  the  repair  cycle 
of  an  asset  can  be  visualized  as  a  queue,  with  arrival 
times  generated  by  the  failure  rate  of  the  asset,  and  the 
service  times  generated  by  the  test  and/or  repair  of  the 
asset  (1:598-623;  8:245-261;  32 : VII-X, 18 ) . 

Therefore,  by  visualizing  the  repair  cycle  of  the 
F-16  as  a  system  of  arrivals,  queues,  and  services,  the 
probability  calculus  and  statistical  analysis  techniques 
can  be  used  to  analyze  the  system. 

Q-GERT  System 

Fortunately,  a  queueing  system  computer  package 
has  been  developed  which  allows  queueing  activities  to  be 
modeled.  Although  the  framework  and  symbology  of  the  sys¬ 
tem  is  available  in  the  computer  package  called  Q-GERT 
(Queueing-Graphical  Evaluation  and  Review  Techniques) ,  the 
sequence  of  events,  parameters,  and  relationships  in  the 
system  must  be  defined  by  the  modelers  based  upon  their 
experience,  knowledge,  and  data  collection  (32) . 

Therefore,  conceptualization  of  the  problem  will 
include  a  clear  statement  of  the  purpose  of  the  system 
being  modeled,  a  clear  statement  of  the  problem  and  what 
benefits  might  accrue  to  the  organization  if  it  were 
solved,  a  well-labeled  structural  model  of  the  system, 
and  a  very  concise  description  of  the  particular  components 
and  relationships  displayed  by  the  model  (9) .  (The 
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conceptual  model  will  be  discussed  in  more  detail  as  the 
system  science  paradigm  is  implemented  in  Chapter  III.  ) 

In  order  to  use  Q-GERT  to  complete  the  second  step 
of  the  system  science  paradigm,  analysis  and  measurement, 
a  visual  and  written  parametric  model  of  the  system  will 
be  constructed.  To  make  these  parameters  consistent  with 
the  data  one  would  probably  encounter  in  the  actual  system, 
values  for  the  parameters  must  be  obtained  from  real  world 
data  collection  systems.  In  addition,  it  will  be  neces¬ 
sary  to  outline  the  experimental  design  that  will  be  used 
to  ensure  proper  analysis  of  simulation  results  and  experi¬ 
mentation  (9)  . 

The  third  phase  of  the  system  science  paradigm, 
computerization,  will  be  accomplished  using  the  Q-GERT 
package  and  the  developed  operational  computerized  model. 
During  the  computerization  of  the  model,  it  will  be  neces¬ 
sary  to  code  the  computer  simulation  model  which  will  be 
developed  from  the  structural  and  parametric  models.  It 
will  also  be  necessary  to  test  and  experiment  with  the 
model  by  varying  the  independent  variable (s)  (the  number 
of  AIS  test  sets)  to  determine  their  impact  on  the  depen¬ 
dent  variable (s)  (average  LRU  waiting  time  in  the  AIS 
queue)  (1:615-617;  26:457-459;  39:219-231).  Finally,  a 
summary  of  simulation  output  and  final  results  of  the 
experiment  will  be  required. 
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Scope/Limitations:  The  F-16  Ultra-High 
Frequency  Receiver/ Transmitter 
and  Waiting  Time 

Due  to  the  amount  of  data,  one  particular  LRU 
of  the  F-16  will  be  used  to  generate  the  parameters  of 
the  repair  cycle.  Although  the  structural  and  computer¬ 
ized  models  will  be  general  enough  to  simulate  any  or 
all  F-16  LRUs,  only  the  ultra-high  frequency  (UHF) 
receiver/ transmitter  (R/T)  will  be  used  to  conduct  the 
simulation  experiment.  The  UHF  R/T  was  chosen  because  it 
represented  the  most  failures  and  maintenance  actions 
among  the  F-16  avionics  subsystems  (31) . 

The  experiment  will  attempt  to  determine  how 
many  automated  test  sets  will  significantly  reduce  LRU 
waiting  time  in  the  AIS.  Any  policy  decisions  made  as  a 
result  of  this  experiment  must  be  tempered  by  resource 
constraints  and  within  the  "bounded  rationality"  of  the 
decision  maker's  knowledge  and  experience. 

For  example,  the  decision  maker  may  decide  that 
a  reduction  of  average  waiting  time,  AT,  is  of  practical 
significance.  The  model  can  then  address  the  question 
"if  one  test  set  is  added,  has  this  AT  been  realized?" 

Finally,  the  relationship  between  the  number  of 
automated  test  sets  and  sortie  generation  will  not  be 
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examined,  even  though  one  might  expect  sortie  generation 
to  increase  if  fewer  LRUs  were  awaiting  service  in  the 
AIS.  Limitations  on  the  experiment,  then,  rest  with  the 
limits  on  real-world  data.  The  simulation  results  will 
only  be  as  accurate  as  the  real-world  maintenance  data 
used  to  generate  the  parameters. 

Cones  of  resolution  can  be  employed  to  visually 
display  the  methodology  of  the  simulation  (36:290-292). 

Beer  introduced  the  term  "cones  of  resolution”  to  denote 
a  hierarchical  arrangement  of  models  (36:290).  The  term 
has  been  formally  defined  as: 

.  .  .  hierarchically  arranged  levels  of  conceptual¬ 
ization  with  the  most  abstract  at  the  top  and  the  most 
concrete  at  the  bottom.  Each  distinguishable  feature 
at  one  level  may  represent  a  wealth  of  detail  when 
examined  on  a  larger  scale  at  a  lower  level  [36:336]. 

One  cone  of  resolution  represents  the  development  of  the 
paradigm  used  in  the  simulation,  while  the  other  repre¬ 
sents  the  process  of  narrowing  the  scope  of  the  experiment 
to  the  UHF  R/T  LRU  of  the  F-16  system.  These  cones  of 
resolution  are  depicted  in  Figures  Sand  7. 

Data  Collection  Plan 

Data  collection  will  be  used  to  determine  the 
probability  distributions  associated  with  failure  rates 
and  repair  times  of  the  UHF  R/T.  In  addition,  parameters 
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Fig.  6.  Methodology  Cones  of  Resolution 
(adapted  from  36:290) 


for  those  distributions,  such  as  the  mean  and  variance, 
will  be  estimated  from  the  data.  Data  will  be  collected 
from  the  Air  Force  Maintenance  Data  Collection  (MDC)  sys¬ 
tem,  the  F-16  real  time  data  collection  system  (CDS) ,  and 
from  offices  in  the  F-16  SPO. 

Appendix  B  is  representative  of  the  LRU  test/ 
repair  data  and  Appendix  C  illustrates  failure  rate  data 
collected  from  the  F-16  SPO ' s  CDS. 

Since  the  backbone  of  much  of  the  estimation  of 
distribution  and  parameters  is  from  CDS,  the  CDS  data 
source  could  be  considered  as  the  most  important  link 
between  the  real  world  and  the  simulation  experiment. 
Therefore,  it  is  important  to  discuss  the  CDS  system  in 
more  detail. 

CDS  Data  Collection  System 

The  F-16  SPO  realized  that  the  need  for  informa¬ 
tion  to  adequately  manage  a  major  weapon  system's  opera¬ 
tion  is  critical.  Decisions  involving  the  procurement  of 
support  equipment,  such  as  the  AIS,  may  involve  millions 
of  dollars  of  DOD  investment  and  may  cause  major  problems 
far  into  the  future  if  decisions  are  hasty,  or  made  without 
the  best  and  most  current  information. 

With  the  goal  of  improving  the  information  and 
communications  for  the  management  of  the  F-16  program. 


the  procurement  of  the  computerized  logistics  decision 
support  package,  CDS,  became  necessary. 

The  ATE-CDS  Program  focuses  the  interest  in  sup¬ 
port  activities  on  the  crucial  automatic  test  equip¬ 
ment  sets  which,  on  prior  aircraft  development  programs 
by  the  Air  Force,  have  been  a  source  of  both  technical 
and  management  concern  [13:pp.  1-2  to  1-3] . 

The  DRC  suggested  that  the  CDS  decision  support 
system  had  two  relevant  issues:  technical  and  managerial. 
The  maintenance  event  data,  the  technical  issue,  provides 
comprehensive  information  collected  in  a  timely  manner  on 
all  the  LRUs,  component  items,  and  the  AIS  itself.  The 
data  provides  for 

.  .  .  detailed  engineering,  configuration  and 
logistics  data  on  these  critical  support  equipments 
as  well  as  further  data  on  the  aircraft  systems  main¬ 
tained  by  the  support  equipment  [13: p.1-4]. 

The  managerial  issue  is  the  effective  management 
control  of  the  AIS,  including  logistics  support,  relia¬ 
bility,  maintainability,  and  test  capabilities.  The  CDS 
goal  is  to  allow  the  program  manager  to  maintain  very  close 
control  and  develop  management  continuity  for  the  very 
complex  AIS  (13:p.l-5). 

Data  collection  and  data  output  are  the  two  major 
functions  of  the  ATE-CDS .  The  ATE-CDS  will  provide  test 
station,  LRU,  or  aircraft  reliability,  maintainability, 
and  support  operational  requirements  data.  It  will  also 
provide  management  information  on  AIS  usage,  test  station 
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status,  LRU  status,  mean  time  between  demand,  parts  track¬ 
ing,  asset  status,  and  AIS  configuration  (13:pp.3-22  to 
3-33)  . 

Thus,  the  CDS  information  system  allows  for  real¬ 
time  accessibility  to  F-16  operations  and  maintenance 
data  and  will  be  the  prime  source  for  data  collection  for 
this  research. 

LRU  Data  Collection 

Through  the  use  of  the  CDS  computer  system  at  the 
F-16  SPO,  maintenance  data  will  be  collected  on  the  five 
LRUs  that  are  currently  tested  on  the  RF  station  of  the 
AIS.  One  LRU,  the  UHF  R/T,  work  unit  code  63BA0,  was 
selected  as  the  subject  for  statistical  testing. 

Maintenance  times  for  AIS  testing  of  the  UHF  R/T 
and  the  corresponding  times  to  repair  the  unit  at  the 
intermediate  level,  will  be  taken  from  CDS.  The  data  will 
be  taken  for  maintenance  action  taken  codes  C  and  F,  test¬ 
ing  with  repair  deferred  and  testing  with  repair,  respec¬ 
tively  . 


Data  Analysis  Plan:  Application 
of  Statistical  Analysis 

Statistical  techniques  will  be  used  to  analyze  the 
data.  In  order  to  run  the  Q-GERT  simulation  model,  it  will 
be  necessary  to  determine  probability  distributions  and 
parameters  for  those  distributions.  The  distributions  and 
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parameters  will  then  be  input  into  the  Q-GERT  model  and  the 
simulation  will  be  executed  (3;  9;  32). 

Data  analysis  will  begin  with  the  time-to-test 
and  time-to-repair  data  points  for  the  UHF  R/T.  Initially, 
a  histogram  will  be  run  on  the  time-to-test  and  time-to- 
repair  distributions  to  determine  if  the  distributions 
graphically  resemble  any  of  the  common  distributions 
(i.e.,  normal,  lognormal,  gamma,  exponential,  etc.).  Then, 
goodness-of-f it  tests  will  be  applied  to  test  the  hypo¬ 
thesis  that  the  random  variables  (time-to-test  and  time- 
to-repair)  follow  the  theoretically  specified  distributions 
which  were  derived  from  the  histograms  (10:32-36;  19: 
222-223;  28:200).  Condescriptive  statistics  will  also  be 
obtained  so  that  the  means  and  standard  deviations  of 
time-to-test  and  time-to-repair  can  be  estimated.  Deter¬ 
mination  of  probability  distributions  and  parameters  of 
time-to-test  and  time-to-repair  will  be  used  to  represent 
service  times  in  the  Q-GERT  model. 

Next,  parameters  and  distributions  for  arrival 
rates  must  be  ascertained.  The  failure  rate  of  the  UHF 
R/T  will  be  used  to  generate  arrival  rates  specifications 
for  the  Q-GERT  model.  The  arrival  rate  of  LRUs  to  the 
AIS  will  be  obtained  from  the  F-16  SPO  CDS-provided  mean 
time  between  maintenance  action  data.  The  mean  of  the 
means  will  be  calculated  and  the  Central  Limit  Theorem 
will  be  applied  in  order  to  estimate  the  distribution  and 
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parameters  for  arrival  rate.  Since  the  Central  Limit 
Theorem  is  used,  the  probability  distribution  will  be 
the  normal  distribution.  However,  the  mean  and  standard 
error  of  the  distribution  must  be  estimated  by  obtaining 
condescriptive  statistics  {3;  33;  34). 

Analysis  of  Results  Plan:  Validation 
and  Statistical  Testing 

After  the  data  has  been  analyzed,  the  probability 
distributions  and  parameters  estimated,  the  Q-GERT  simula¬ 
tion  model  is  ready  to  run.  Upon  completion  of  the  Q-GERT 
simulation,  it  will  be  necessary  to  analyze  the  results. 
Therefore,  the  analysis  of  results  plan  calls  for  internal 
validation  of  the  Q-GERT  generated  results  and  statistical 
testing  of  the  Q-GERT  generated  output  (9;  39:219-231). 

The  validation  process  will  consist  of:  (1)  tracing 
transactions  through  the  Q-GERT  network  in  order  to  vali¬ 
date  that  transactions  (LRUs)  are  following  appropriate 
paths  through  the  system,  and  (2)  validation  of  the  dis¬ 
tributions  generated  by  the  Q-GERT  program  to  ensure  that 
the  simulation  generated  distributions  are  consistent  with 
real-world  data  estimated  distributions.  Histograms  and 
goodness-of-f it  tests  will  be  applied  to  the  Q-GERT 
generated  distributions  (10:32-36;  19:312-313;  20:25,31). 

After  the  model  has  been  validated,  it  will  be 
run  three  different  times.  Each  time,  the  independent  or 
control  variable,  the  number  of  AIS  test  sets,  will  be 


increased  from  one  to  two  to  three.  The  length  of  each 
run  and  number  of  runs  will  be  increased  until  the  vari¬ 
ance  of  the  response  surface  within  each  run,  and  between 
the  runs,  stabilizes  (9) . 

In  short,  the  control  variable,  number  of  AIS, 
will  be  varied  from  one  to  three  and  its  effect  on  the 
response  or  dependent  variable,  average  waiting  time  in 
AIS  queue,  will  be  recorded  (9;  26:294,457-459;  39:150-152). 

Finally,  an  analysis  of  variance  (ANOVA)  program 
will  be  used  to  test  the  difference  in  means  of  the 
response  surface.  If  the  ANOVA  results  indicate  that  the 
variances  or  the  treatments  are  not  equal,  then  a  non- 
parametric  Kruskal-Wallis  analysis  of  variance  test  will 
be  conducted  (19:305-306,220-239;  26:456-489;  28:398-432). 

Theory  Testing  Methodology 

Research  Question  #1:  Character¬ 
ization  of  Arrival  and  Service 
Random  Variables 

The  methodology  which  will  be  used  to  answer 
research  question  #1,  determining  probability  distribu¬ 
tions  and  parameters  for  failure  rates,  time  to  test  and 
time  to  repair,  consists  of:  (1)  searching  Air  Force  main¬ 
tenance  data  collection  systems  to  determine  if  such 
information  is  collected,  and  (2)  applying  histograms,  con- 
descriptive  statistics,  goodness-of-f it  tests  to  the  data 
(if  available)  so  that  the  distributions  can  be  estimated. 
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Q-GERT  model.  Research  question  #2  asks  if  a  change  in  the 
average  waiting  time  occurs  when  the  number  of  AIS  test 
sets  change.  Parametric  and/or  nonparametric  statistical 
tests  (such  as  ANOVA  and  Kruskal-Wallis  tests)  will  be 
applied  to  the  response  surface  to  determine  if  the  change 
in  AIS  test  sets  statistically  changed  average  LRU  waiting 
times. 

Research  Question  #3:  The  Practical 
Significance  Issue 

Research  question  #3  attempts  to  determine  the 
practical  significance  of  the  change  in  waiting  time  as 
the  number  of  test  sets  change .  While  rigid  statistical 
tests  cannot  be  used  to  ascertain  practical  significance, 
an  analysis  of  the  actual  waiting  times  distributions  and 
parameters,  based  on  the  knowledge  and  experience  of  DOD 
logistics  managers  and  a  critical  review  of  qualitative 
decision-making  literature,  could  provide  qualitative 
answers  to  the  question  of  practical  significance.  There¬ 
fore,  the  methodology  used  to  answer  research  question  #3 
will  consist  of  a  review  of  the  actual  numbers  generated 
for  average  waiting  time  for  different  quantities  of 
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test  sets  and  a  literature  search  to  determine  the  limita¬ 
tions  on  purely  quantitative  decision  support  systems. 


Summary 

All  of  the  tests  and  procedures  to  be  used  that 
would  validate  and  test  the  results  of  the  model  are  out¬ 
lined  in  Table  2.  Figure  8  shows  the  detailed  methodology 
used  when  the  system  science  paradigm  is  implemented. 


TABLE  2 

CORRELATION  OF  RESEARCH  QUESTION  AND  METHODOLOGIES 


Research  Question 


1 .  Characterization  of 
arrival  and  service 
random  variables 


2.  Relationship  between 
AIS  test  sets  and  LRU 
waiting  time 


3.  The  practical  signifi¬ 
cance  issue 


Methodology 


1.  Maintenance  data  collec¬ 
tion,  histograms,  con- 
descriptive  statistics, 
goodness-of-f it  tests 

2.  Parametric  and  nonpara- 
metric  statistical  test¬ 
ing,  ANOVA,  Kruskal- 
Wallis  Test 

3.  Condescriptive  statistics 
Central  Limit  Theorem, 
critical  literature 
review,  knowledge,  experi 
ence 
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CHAPTER  III 


FINDINGS 

Introduction:  The  System  Science 
Paradigm  Implemented 

Findings  will  be  reported  within  the  framework  of 
the  system  science  paradigm  and  will,  therefore,  follow 
the  outline  of  conceptualization,  analysis  and  measurement, 
and  computerization  (36:295-303).  Under  the  conceptualiza¬ 
tion  step  of  the  system  science  paradigm,  the  following 
findings  will  be  reported:  (1)  the  purpose  of  the  system 
being  modeled;  and  (2)  a  structural  model  of  the  system, 
with  a  description  of  the  components  and  relationships  dis¬ 
played  by  the  model . 

In  the  next  step  of  the  system  science  paradigm, 
analysis  and  measurement,  the  findings  will  consist  of: 

(1)  a  visual  and  written  parametric  model,  and  (2)  the 
experimental  design  used  to  ensure  proper  analyses  of 
simulation  results  and  experimentation. 

Third,  the  computerization  step  of  the  system 
science  paradigm  will  provide  the  following  findings: 

(1)  a  listing  of  the  computer  simulation  model  which  was 
developed  from  the  structural  and  parametric  models, 

(2)  a  summary  of  the  steps  that  were  completed  as  model 
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experimentation  occurred,  and  (3)  a  summary  of  simulation 
output  and  the  final  results  of  the  experiment. 

After  the  findings  have  been  reported  in  the  frame¬ 
work  of  the  system  science  paradigm,  they  will  be  summar¬ 
ized  according  to  their  relationship  to  the  research  ques¬ 
tions.  The  findings,  then,  will  consist  of  the  simulation 
output,  the  results  of  using  the  system  science  paradigm 
as  a  problem-solving  methodology,  and  their  relevance  to 
the  research  questions. 

Step  I.  Conceptualization 

Purpose:  Modeling  the 
Real  World 

The  purpose  of  the  model  is  to  simulate  the  arrival, 
waiting,  testing,  repairing,  and  return  of  the  UHF  receiver/ 
transmitter  as  it  is  removed  from  the  aircraft,  inspected 
and/or  repaired  at  the  AIS,  and  returned  to  service,  or 
sent  to  the  depot  for  repair  and  return  (i.e.,  not  repar¬ 
able  this  station — NRTS ) . 

As  discussed  in  Chapter  I,  waiting  time  for  an 
available  AIS  test  set  is  a  significant  factor  in  deter¬ 
mining  the  number  of  AIS  test  sets  to  acquire.  By  model¬ 
ing  the  repair  cycle  of  the  LRU,  a  "satisficing"  quantity 
of  AIS  test  sets  which  statistically  significantly  reduces 
intermediate  repair  waiting  time  could  be  determined. 
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Structural  Model:  A 
Causal-Loop  Diagram 

A  causal-loop  diagram  of  intermediate  repair  of 
F-16  LRUs  might  be  depicted  as  shown  in  Figure  9. 

The  structural  model  indicates  that  as  the  failure 
rate  of  LRUs  increases,  the  number  of  LRUs  requiring  main¬ 
tenance  increases.  As  the  number  of  LRUs  requiring  main¬ 
tenance  increases,  the  time  a  LRU  spends  waiting  for  test 
or  repair  increases.  As  the  number  of  LRUs  requiring  main¬ 
tenance  increases,  the  number  of  AIS  test  sets  should 
increase.  As  the  number  of  AIS  test  sets  increases,  the 
time  to  test  a  LRU  decreases.  Also,  as  the  number  of  AIS 
test  sets  increase,  the  time  to  repair  a  LRU  decreases. 
Conversely,  as  test  time  or  repair  time  increases,  the 
number  of  AIS  test  sets  required  should  increase. 

However,  if  the  time  to  test  a  LRU  increases,  the 
time  a  LRU  would  spend  waiting  for  testing  or  repair  would 
increase.  Likewise,  if  the  time  to  repair  a  LRU  increased, 
the  time  waiting  for  test  or  repair  would  increase.  As 
time  waiting  for  test  or  repair  increases,  the  number  of 
AIS  test  sets  should  increase. 

As  the  number  of  aircraft  flown  increases,  the  num¬ 
ber  of  LRUs  requiring  maintenance  should  increase.  As  the 
number  of  aircraft  increases,  the  number  of  flying  hours 
should  increase.  As  the  number  of  flying  hours  increases. 
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the  number  of  failed  LRUs  should  rise.  As  the  number  of 
failed  LRUs  increases,  the  number  of  LRUs  requiring  main¬ 
tenance  will  increase. 

If  the  control  and  stochastic  variables  of  the 
model  can  be  identified,  as  in  the  causal-loop  diagram, 
their  influence  on  the  response  variables  can  be  determined. 
Therefore,  a  logistics  manager  would  be  able  to  model  the 
changes  in  the  response  variables  as  a  result  of  the 
changes  in  the  control  variables.  Thus,  if  a  F-16  logis¬ 
tics  manager  wants  to  reduce  the  waiting  time  for  a  LRU 
(response  variable)  by  varying  the  number  of  AIS  test  sets 
(control  variable) ,  the  effect  of  these  decisions  can  be 
evaluated  by  modeling. 

Step  II.  Analysis  and  Measurement 

Parametric  Model:  The  Structural 
Model  Quantified 

Parameters  were  estimated  from  data  obtained  from 
the  F-16  SPO  and  by  observing  the  LRU  repair  cycle  process 
shown  in  Figure  5  (31)  .  Interarrival  of  LRUs  to  the  AIS 
was  obtained  from  failure  rate  data,  Appendix  C  (31).  The 
mean  of  the  means  was  calculated  and  the  Central  Limit 
Theorem  applied,  which  resulted  in  the  mean-time-between- 
maintenance  actions  following  a  normal  distribution,  with 
a  mean  of  150.6  hours  and  a  standard  deviation  of  81.9 
hours  (see  Appendix  D)  (3;  26:197-198;  34). 
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A  small  Q-GERT  program.  Figure  10,  was  designed  and 
run  using  the  normally  distributed  statistics  to  generate 
interarrival  times.  The  small  Q-GERT  program  was  neces¬ 
sary  because  interarrival  time  data  was  not  available  from 
the  SPO.  Further,  the  mean-time-between-maintenance- 
action  raw  data  (Appendix  C)  could  not  be  used  in  the  full 
Q-GERT  model  of  the  system  because  Q-GERT  is  limited  to 
50  servers  per  network  (9)  and  two  of  the  three  wings/ 
bases  to  be  modeled  required  96  servers  each.  (Nellis, 

Hill  and  MacDill  Air  Force  Bases  required  96,  96,  and  48 
servers,  respectively.)  The  small  Q-GERT  program  generated 
arrival  times,  shown  in  Table  3,  to  approximate  the  average 
time  between  arrivals  of  a  LRU  to  the  AIS  (32:21-31) . 


Table  3  reveals  that  interarrival  times  were  com¬ 
puted  by  simply  subtracting  the  computer  generated  arrival 
time  from  the  next  highest  generated  arrival  time.  These 
50  interarrival  times  were  then  used  to  obtain  condescrip- 
tive  statistics.  These  same  data  points  were  then  grouped 
into  ten  groups  and  formed  a  histogram  for  a  visual  repre¬ 
sentation  of  the  probability  density  function.  The  results 
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TABLE  3 


INTERARRIVAL  TIME  DATA 
(Mean  =  6.635) 


Time  of 
Arrival  at 
AIS 

Inter- 

Arrival 

Time 

Time  of 
Arrival  at 
AIS 

Inter- 

Arrival 

Time 

10.52 

• 

157.71 

6.52 

18.63 

8.11 

174.47 

16.76 

41.26 

22.63 

176.83 

2.36 

51.07 

9.81 

178.37 

1.54 

51.45 

.38 

178.49 

.12 

58.21 

6.76 

179.25 

.76 

68.79 

10.58 

183.76 

4.51 

69.23 

.44 

184.99 

1.23 

90.51 

21.28 

187.77 

2.78 

97.80 

7.29 

191.31 

3.54 

100.99 

3.19 

191.98 

.67 

102.43 

1.44 

197.76 

5.78 

108.87 

6.44 

213.88 

16.12 

110.06 

1.19 

217.46 

3.58 

113.35 

3.29 

228.80 

11.34 

118.71 

5.36 

233.98 

5.18 

118.91 

.20 

234.60 

.62 

119.81 

.90 

240.87 

6.27 

120.07 

.26 

243.16 

2.29 

120.27 

.20 

248.81 

5.65 

121.58 

1.31 

258.41 

9.60 

126.57 

4.99 

263.11 

4.70 

127.58 

1.01 

263.40 

.29 

147.42 

29.84 

272.68 

9.28 

148.75 

1.33 

342.26 

69.58 

151.19 

2.44 
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of  this  exercise  are  shown  in  Appendix  El  and  indicate 
that  the  interarrival  times  are  exponentially  distributed 
with  a  mean  of  6.6  hours  and  a  maximum  value  of  70.0  hours. 

After  the  interarrival  time  random  variable  had 
been  estimated,  the  probability  of  a  LRU  requiring  testing 
only,  or  both  testing  and  repair,  was  calculated.  In  order 
to  determine  the  probability  that  a  LRU  only  required  test¬ 
ing  at  the  AIS,  the  data  from  the  F-16  SPO  (Appendix  B) 
was  analyzed  by  the  work  unit  code  of  the  documented  LRU 
maintenance  actions.  The  probability  that  a  LRU  would  only 
require  testing  time  (i.e.,  tested  and  no  failure  found; 
cannot  duplicate  (CND) ,  or  tested  and  sent  to  depot  for 
repair)  was  determined  to  be  0.10.  Therefore,  the  proba¬ 
bility  that  a  LRU  would  need  both  test  and  repair  at  the 
AIS  was  estimated  at  0.90. 

The  F-16  SPO  data  (Appendix  B)  was  also  used  to 
estimate  the  parameters  of  time-to-test  and  time-to-repair. 
Condescriptive  statistics,  a  histogram,  and  goodness-of- 
fit  tests  of  the  data  in  Table  4  resulted  in  the  time-to- 
test  variable  estimated  to  be  lognormally  distributed  with 
a  mean  of  3.5  hours  and  a  standard  deviation  of  2.2  hours 
as  shown  in  Appendix  E2 . 

The  time-to-repair  random  variable  was  estimated  to 
follow  a  lognormal  distribution  with  a  mean  of  8.1  hours 
and  a  standard  deviation  of  6.9  hours,  as  shown  in  Appen¬ 
dix  E3.  The  estimated  distributions  were  selected  from  the 


45 


TABLE  4 


TEST  AND  REPAIR  TIMES 


WUC (LRU) 

Time-to-Test 

(Minutes) 

T ime - to-Repa ir 
(Minutes) 

1. 

63BA0 

30 

45 

2. 

II 

210 

1030 

3. 

II 

180 

240 

4. 

II 

215 

800 

5. 

II 

170 

120 

6. 

If 

90 

90 

7. 

II 

420 

520 

8. 

II 

180 

1150 

9. 

II 

480 

120 

10. 

II 

195 

1655 

11. 

II 

180 

295 

12. 

II 

210 

330 

13. 

It 

510 

790 

14. 

II 

150 

210 

15. 

»* 

180 

1110 

16. 

II 

455 

420 

17. 

n 

90 

150 

18. 

•• 

160 

95 

19. 

ii 

20 

470 

20. 

ii 

30 

260 

21. 

if 

270 

330 

22. 

n 

210 

720 

23. 

it 

120 

175 

24. 

N 

135 

255 

25. 

If 

150 

360 

26. 

If 

90 

360 

27. 

If 

240 

1200 

28. 

If 

240 

330 

29. 

II 

415 

60 

30. 

ft 

270 

900 

physical  naracteristics  of  each  of  the  histograms,  which 
led  to  testing  the  data  against  specified  theoretical  sta¬ 
tistical  distributions.  To  achieve  this  test,  the  main¬ 
tenance  data  was  hypothesized  to  have  a  lognormal  distri¬ 
bution.  The  Lilliefors  test  for  normality  was  used, 
because  the  population  mean  and  standard  deviation  for  the 
data  sets  were  unknown  (30) .  The  maintenance  data  was 
converted  to  the  logarithms  of  each  value  and  was  tested 
against  the  normal  distribution.  (If  the  variable  is  log- 
normally  distributed,  its  logarithms  will  be  normally  dis¬ 
tributed  (3;  33;  34).) 

Testing  results  for  the  histograms  showed  that  the 
repair  time  might  be  approximated  by  a  lognormal  distribu¬ 
tion.  The  testing  time  histogram.  Appendix  E2,  does  not 
depict  a  classic  lognormal  distribution;  however,  two  of 
the  ten  intervals  had  no  cases  shown,  which  leads  to  a 
compacting  in  the  right-hand  tail  of  the  distribution. 

The  hypothesized  distribution  for  the  time-to-test  was 
also  lognormal,  based  on  the  condescriptive  statistic  of 
positive  skewness,  1.178,  and  the  shape  of  the  histogram 
(10:29-32;  26:45-46;  34).  In  addition,  the  condescriptive 
statistics  of  skewness  for  both  data  sets  are  positive 
values,  indicating  rightward  skewness  and  suggesting  a 
lognormal  distribution  (10:29-32;  26:45-46;  34). 

Of  the  10  percent  of  the  LRUs  that  required  only 
testing,  one-fifth,  or  approximately  2  percent,  were  sent 
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to  the  depot.  The  maintenance  time  for  the  depot  test 
and  repair  was  estimated  to  be  lognormally  distributed 
with  a  mean  of  14.0  hours  and  a  standard  deviation  of  11.9 
hours  (27) .  After  the  critical  queueing  system  character¬ 
istics  of  arrivals  (failure  rate)  and  service  time  (test 
and  repair  time)  had  been  estimated,  definition  of  the 

entire  queueing  system  was  undertaken. 

\ 

System  Definition:  The  F-16 
LRU  Repair  Cycle 

There  are  two  AIS  test  sets  at  Nellis  and  MacDill 
Air  Force  Bases  (27) .  Hill  AFB  has  three  AIS  test  sets 
(27) .  The  depot  (at  Hill  AFF,  Utah)  has  six  test  sets 
available  for  use  (27)  .  The  time  between  removal  of  the 
LRU  from  the  aircraft  until  arrival  of  the  LRU  at  the  base 
AIS  is  estimated  to  be  a  constant  of  one  hour.  Likewise, 
the  time  to  return  a  LRU  from  the  AIS  to  base  supply  or 
the  flight  line  is  estimated  at  a  constant  of  one  hour. 

The  time  to  transport  a  LRU  from  Nellis  AFB,  Nevada,  or 
MacDill  AFB,  Florida,  to  the  depot  is  estimated  to  be  a 
constant  of  twenty-four  hours  (a  LOGAIR  flight  departs 
these  bases  for  Hill  AFB  on  a  daily  basis  (12:20-37) . 

The  time  to  transport  a  LRU  from  the  Hill  AFB  AIS  to  the 
depot  is  estimated  to  be  a  constant  of  one  hour.  Similar 
times  were  estimated  to  return  LRUs  from  the  depot  to  the 
respective  bases.  It  was  assumed  that  the  LRUs  would  be 
returned  to  the  base  having  the  largest  remaining  capacity 
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(that  is,  the  base  with  the  lowest  fill  rate  of  service¬ 
able  LRUs) .  In  summary,  the  system  model  parameters  shown 
in  Table  5  were  estimated  and  verified. 

Other  parametric  models  developed  were: 

1.  Time  in  AIS  for  test  =  Test  Time 

2.  Time  in  AIS  for  repair  =  Test  Time  + 

Repair  Time 

3.  Waiting  time  in  AIS  =  Test  Time  +  Repair 
Time  -  Time  of  Arrival 

The  Q-GERT  Model 

All  of  the  parameters,  assumptions,  logic,  and 
real-world  limitations  have  now  been  developed.  A  Q-GERT 
model  can  now  be  developed  which  integrates  all  of  these 
factors  and  simulates  the  real  world.  Figure  11  is  a 
visual  depiction  of  the  model  using  standard  Q-GERT  symbols. 
(For  a  complete  description  of  Q-GERT  symbology,  see  Appen¬ 
dix  A.) 

The  model  simulates  the  repair  cycle  at  three  Air 
Force  bases  (Nellis,  Hill,  and  MacDill)  and  the  depot 
repair  facility,  also  located  at  Hill  AFB.  Although 
selector  node  2  is  shown  first,  the  system  actually  begins 
with  Q  nodes  5,  40,  and  70.  These  nodes  hold  operational 
and  spare  LRUs.  They  represent  96  operationally  ready 
aircraft  and  four  spare  LRUs  for  Nellis  and  Hill  AFBs 
respectively,  and  48  operationally  ready  aircraft  and  two 
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TABLE  5 


MODEL  PARAMETERS 


Distribution/ 


Variable 

Constant 

Mean 

Std  Dev 

Verified  by 

Interarrival 

Time 

Exponential 

6.635 

N/A 

SPSS/Q-GERT 

Prob  of  Test 

.10 

N/A 

N/A 

F-16  Data 

Prob  of  Test 
and  ftbint 

.90 

N/A 

N/A 

F-16  Data 

Time-to-Test 

Lognormal 

3.49 

2.17 

SPSS 

Time-to-Repair 

Lognorrtal 

8.11 

6.9 

SPSS 

Prob  of  NRTS 

.02 

N/A 

N/A 

F-16  Data 

Depot  Repair 

Time 

Lognormal 

14.0 

11.91 

Depot 

Nellis  Test 

Sets 

2 

N/A 

N/A 

Data 

MacDill  Test 

Sets 

2 

N/A 

N/A 

Data 

Hill  Test 

Sets 

3 

N/A 

N/A 

Data 

Depot  Test 

Sets 

6 

N/A 

N/A 

Data 

spare  LRUs  for  MacDill  AFB.  Activities  2,  20,  and  40 
generate  interarrival  times  using  parameter  set  1  (see 
legend,  Figure  11)  for  reparable  (broken)  LRUs.  These 
transactions  are  then  assigned  attributes  (AT)  1  at  nodes 
10,  45,  and  75.  The  attributes  are  taken  from  a  uniform 
distribution  using  parameter  set  2  (see  legend,  Figure  11). 
Attribute  1  assigns  the  probability  that  a  transaction 
(LRU)  will  require  testing  only  (0.10),  testing  and  repair 
(0.90),  and/or  NRTS  (0.02). 

Next,  the  transactions  move  to  conditional  branch¬ 
ing  nodes  11,  46,  and  76.  Here,  AT  1  is  used  to  deter¬ 
mine  the  correct  path  for  the  LRU.  If  AT  1  is  less  than, 
or  equal  to,  0.10,  the  LRU  moves  to  nodes  12,  47,  or  77. 
These  nodes  represent  test  only  and  attribute  2  is  assigned 
using  parameter  set  4  (see  legend,  Figure  11) .  If  AT  1 
is  greater  than  0.10,  the  LRU  moves  to  nodes  13,  48,  or 
78.  These  nodes  represent  test  and  repair.  Attribute  2 
is  assigned  to  the  LRU  using  both  parameter  set  4  (test 
time)  and  parameter  set  5  (repair  time) . 

From  nodes  12,  13,  47,  48,  77,  or  78  the  LRU  moves 
to  the  respective  repair  shop  Q-node  (nodes  14,  49,  and  79) . 
Here,  the  LRU  either  waits  in  the  queue  for  an  AIS  test 
set  to  become  available,  or  moves  directly  into  the  repair 
cycle  if  a  test  set  is  available.  Test  set  availability 
is  determined  in  allocate  nodes  15,  50,  and  80.  These 
nodes  have  resources  (test  sets)  that  are  limited  to  two 
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at  Nellis  AFB,  three  at  Hill  AFB,  and  two  at  MacDill  AFB. 

At  the  beginning  of  the  simulation  all  test  sets  are  avail¬ 
able.  When  a  LRU  is  allocated  a  test  set,  the  resources 
are  decremented  by  one  until  the  time  assigned  to  AT  2  for 
that  LRU  has  elapsed.  That  resource  cannot  be  used  again 
until  it  is  freed  at  nodes  25,  60,  and  90. 

From  nodes  15,  50,  and  80,  the  LRU  moves  to  regular 
nodes  20,  55,  or  85.  These  nodes  are  used  to  move  the  LRU 
through  the  system.  Activities  8,  26,  and  46  represent 
the  AIS  test  and  repair  activities.  Here  is  where  service 
time  occurs  based  upon  AT  2.  Once  a  LRU  has  been  tested, 
repaired,  or  NRTS'd,  it  flows  to  conditional  branching 
nodes  25,  60,  or  90.  These  nodes  serve  a  dual  purpose. 
First,  they  free  the  resource  (test  set)  to  make  it  avail¬ 
able  for  use.  Second,  based  on  attribute  1,  the  deter¬ 
mination  is  made  whether  the  LRU  is  tested  and  returned  to 
the  aircraft  or  base  supply  without  repair,  tested  and 
repaired  and  returned  to  the  aircraft  or  base  supply,  or  if 
it  is  not  reparable  this  station  (NRTS)  and  sent  to  the 
depot  for  repair.  In  the  first  two  cases,  if  AT  1  is 
greater  than,  or  equal  to,  0.02,  the  LRU  is  returned  to 
Q-node  5,  40,  or  70,  and  the  number  in  the  supply  queue  is 
incremented  by  one.  If  AT  1  is  less  than  0.02,  the  LRU 
is  sent  to  depot  (Q-node  95)  with  time  assigned  at  activi¬ 
ties  10,  28,  and  48.  In  the  case  of  Nellis  and  MacDill 
AFBs,  the  time  is  a  constant  of  48  hours  (24  hours  to  the 
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depot  and  24  hours  back  to  the  respective  base) .  For 
Hill  AFB,  a  constant  two  hours  is  assigned  (one  hour  to 
the  repair  facility  and  one  hour  for  return) .  From  node 
95,  activity  50  assigns  a  depot  repair  time  using  param¬ 
eter  set  3  (see  legend,  Figure  11) .  The  LRU  then  moves 
to  selector  node  2  where  the  determination  is  made  which 
base  has  the  largest  remaining  capacity  (difference  between 
authorized  and  on-hand  LRUs) .  Once  the  selection  has 
been  made,  the  appropriate  supply  Q-node  (5,  40,  or  70) 
is  incremented  by  one. 

Experimental  Design:  Treatments 
and  Observations 

The  experiment  was  designed  to  measure  the  response 
variable  (average  waiting  time)  as  changes  in  the  control 
variable  (number  of  test  sets)  occurred.  The  stochastic 
variables  would  change  based  on  sampling  random  numbers 
from  appropriate  distributions  as  characterized  by  the 
parametric  distributions  of  the  stochastic  variables.  The 
variables  in  Table  6  are  applicable  to  the  experimental 
design. 

For  this  experiment,  the  number  of  test  sets 
available  was  varied  from  one  to  three  in  order  to  deter¬ 
mine  its  effect  on  the  average  waiting  time  in  the  AIS. 

Each  treatment  (number  of  test  sets)  was  simulated 
for  a  30-day  period.  Twelve  30-day  periods  were 
plotted  with  their  corresponding  average  waiting  times. 
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An  analysis  of  variance  test  will  be  conducted  to  deter¬ 
mine  if  the  mean  waiting  time  in  the  AIS  is  statistically 
significantly  different  when  there  are  one,  two,  or  three 
test  sets  available  to  support  intermediate  test  and/or 
repair  of  the  F-16  LRU.  If  the  means  are  essentially  the 
same,  one  test  set  should  be  the  basis  of  decision  making 
when  attempting  to  determine  support  equipment  requirements 
for  I-level  repair  of  the  F-16.  If  the  means  are  differ¬ 
ent,  statistical  tests  will  be  applied  to  determine  how 
far  apart  the  means  are.  If  the  analysis  of  variance 
indicates  that  there  is  a  difference  in  mean  waiting  time 
between  one  and  two  test  sets,  but  not  between  two  and  three 
test  sets,  two  sets  should  be  the  basis  for  beginning  the 
discussion  of  how  many  test  sets  to  acquire  to  support 
I-level  repair  of  F-16  LRUs.  However,  any  decision  should 
include  both  the  statistically  generated  solution  and  its 
impact  on  the  practical  significance  issues  as  identified 
by  the  decision  maker  within  the  context  of  the  resources 
available  in  the  environment. 

Step  III.  Computerization 

Computer  Listing 

A  listing  of  the  computer  simulation  model  used 
to  simulate  the  intermediate  repair  of  F-16  LRUs  is  pro¬ 
vided  in  Appendix  F. 
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Model  Experimentation 


Upon  completion  of  the  parametric  model  and  the 
coding  and  running  of  the  appropriate  Q-GERT  model,  vali¬ 
dation  of  the  parameters  generated  by  the  Q-GERT  simula¬ 
tion  was  attempted.  The  validation  process  consisted  of: 

(1)  tracing  transactions  through  the  network  in  order  to 
validate  that  transactions  (LRUs)  were  following  appropri¬ 
ate  paths  through  the  system  (see  Appendix  G) ;  and 

(2)  validation  of  the  distributions  generated  by  the  Q-GERT 
program.  Histograms  and  goodness-of-f it  tests  were  applied 
to  the  Q-GERT  generated  distributions  (19:220-239,312-313; 
20:25,31;  22).  The  tests  and  printouts,  as  shown  in  Appen¬ 
dix  H,  indicate  that  the  Q-GERT  model  generated  distribu¬ 
tions  were  representative  of  the  parametric  model  distribu¬ 
tions  based  on  real-world  data.  Specifically,  Appendix  HI 
verifies  that  the  depot  maintenance  times  generated  by  the 
Q-GERT  simulation  are  lognormally  distributed.  Appendix  H2 
shows  that  the  simulation  generated  intermediate  level 
repair  times  are  lognormally  distributed.  Confirmation  of 
lognormally  generated  intermediate  level  test  times  was 
provided  by  Appendix  H3 .  Appendix  H4  confirmed  that  the 
Q-GERT  simulation  model  was  providing  attribute  assignments 
from  the  required  uniform  distribution.  Appendix  H5  vali¬ 
dated  the  exponential  distribution  of  LRU  interarrival 
times. 
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Based  on  the  trace  of  transactions  and  the  applica¬ 
tion  of  goodness-of-fit  tests,  the  Q-GERT  model  was  deter¬ 
mined  to  be  an  internally  validated  representation  of  the 
system  of  intermediate  level  repair  of  F-16  LRUs.  After 
the  model  had  been  validated,  it  was  run  with  one  A1S  test 
set  as  a  server,  two  AIS  test  sets  as  servers,  and  three 
AIS  test  sets  as  servers .  Each  run  consists  of  30  days  of 
activity.  Twelve  runs  of  the  30-day  period  were  used  to 
simulate  one  year's  activity.  The  30-day  and  12-month 
periods  were  chosen  in  order  to  stabilize  the  variance  of 
the  average  waiting  time  in  the  AIS  queue.  In  short,  the 
control  variable  (number  of  AIS  test  sets)  was  varied  from 
one  to  three  and  its  effect  on  the  response  variables 
(average  waiting  time  in  the  AIS  queue)  was  recorded. 

Twelve  observations  (based  on  a  30-day  observation  period) 
were  documented  by  the  Q-GERT  analysis  program  (as  shown 
in  Appendix  I) .  A  response  surface  of  the  treatment  (vary¬ 
ing  the  number  of  test  sets)  and  results  (average  waiting 
time  in  the  queue)  are  shown  in  Table  7. 

Simulation  Output 

A  summary  of  12  observations  of  average  waiting 
time  in  the  AIS  queue  is  provided  in  Appendix  I.  An 
analysis  of  variance  program  was  used  to  test  the  differ¬ 
ence  in  means  of  the  response  surface  (see  Appendix  Jl) . 
Since  the  ANOVA  indicated  that  the  variances  of  the  three 


RESPONSE  SURFACE 


103.2550  12  2  7.4907  12  3  1.3509 


treatments  were  not  equal,  a  nonparametric  Kruskal-Wallis 
analysis  of  variance  test  was  conducted  (Appendix  J2) . 

The  results.  Appendix  Jl,  indicated  that  the  mean  waiting 
time  in  the  AIS  queue  is  greater  if  only  one  AIS  test  set 
is  available;  however,  the  average  waiting  time  in  the  AIS 
is  not  statistically  significantly  different  if  two  or 
three  AIS  test  sets  are  available.  Specifically,  when  the 
simulation  was  executed  with  one  AIS  test  set  as  the 
server,  the  average  waiting  time  was  normally  distributed 
(Central  Limit  Theorem)  with  a  mean  of  130.5  hours  and  a 
standard  error  of  19.3  hours  as  shown  in  Appendix  J3.  When 
two  AIS  test  sets  were  available  as  servers,  the  average 
waiting  time  was  normally  distributed  (Central  Limit 
Theorem)  with  a  mean  of  12.4  hours  and  a  standard  error  of 
10.3  hours  (Appendix  J3) .  When  three  AIS  test  sets  were 
available  for  service,  the  average  waiting  time  was 
normally  distributed  (Central  Limit  Theorem)  with  a  mean 
of  1.2  hours  and  a  standard  error  of  0.5  hours  (Appen¬ 
dix  J3) .  Table  8  summarizes  the  impact  of  the  number  of 
AIS  test  sets  on  LRU  average  waiting  time  for  service.  At 
the  99  percent  confidence  level,  the  population  distribu¬ 
tions  of  average  waiting  time  for  two  and  three  test  sets 
are  statistically  the  same  (Appendix  Jl) .  However,  if  the 
practical  significance  of  the  addition  of  a  test  set  was 
to  reduce  mean  average  waiting  time  by  ten  (10)  hours, 
then  the  difference  in  average  waiting  time  would  be 
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TABLE  8 


EFFECT  OF  CHANGE  IN  AIS  TEST  SETS  ON  LRU 
AVERAGE  WAITING  TIME 


Number 
AIS  Test 

of 

Sets 

Average  Waiting  Time 

in  Hours 

Distribution 

Mean 

Standard  Error 

1 

Normal 

130.485 

19.2839 

2 

Normal 

12.3976 

10.3245 

3 

Normal 

1.2115 

0.5384 

significant  because  the  third  test  set  reduced  mean 
average  waiting  time  by  11.2  hours  {12.3976  -  1.2115). 

Findings  and  Their  Relevance 
to  Research  Questions 

Research  Question  #1:  Character¬ 
ization  of  Arrival  and  Service 
Random  Variables 

The  interarrival  time  probability  distribution  was 
found  to  be  estimatable  by  an  exponential  distribution 
(histogram.  Appendix  El),  with  a  mean  of  6.6  hours  and  a 
maximum  value  of  70.0  hours  (condescriptive  statistics. 
Appendix  El) .  The  time-to-test  random  variable  findings 
resulted  in  an  estimated  lognormal  distribution  (histogram, 
goodness-of-f it  test.  Appendix  E2) ,  with  a  mean  of  3.5 
hours  and  a  standard  deviation  of  2.2  hours  (condescrip¬ 
tive  statistics,  Appendix  E2) .  Findings  for  the  time-to- 
repair  random  variable  resulted  in  an  estimated  lognormal 
distribution  (histogram,  goodness-of-f  it  test.  Appendix  E3)  , 


with  a  mean  of  8.1  hours  and  a  standard  deviation  of  6.9 
hours  (condescriptive  statistics,  Appendix  E3) . 

Research  Question  #2:  Relationship 
Between  AIS  Test  Sets  and  LRU 
Waiting  Time 

The  analysis  of  variance  findings,  Appendix  Jl, 
showed  that  the  variance  among  the  three  groups  of  average 
waiting  times  was  not  the  same  (P  values  for  Cochran's  C 
and  Bartlett's  Box  are  0.000);  therefore,  a  nonparametric 
analysis  of  variance  test  must  be  conducted.  The  nonpara¬ 
metric  Kruskal-Wallis  one-way  ANOVA  test.  Appendix  J2, 
resulted  in  a  significance  value  finding  of  0.000,  thus, 
average  waiting  times  for  the  three  treatments  of  one, 
two,  and  three  AIS  test  sets  are  not  the  same. 

Since  the  findings  relative  to  research  question  #2 
indicated  that  there  was  a  difference  in  average  waiting 
times  when  the  number  of  test  sets  was  changed,  the 
Duncan's  Multiple  Range  Test,  Appendix  Jl,  was  used  to 
determine  if  average  waiting  times  were  the  same  when  one 
or  two  test  sets  were  available.  The  findings  reveal  that 
the  group  representing  one  AIS  test  set  (group  1)  was 
placed  in  a  unique  subset  (subset  2)  and  would  therefore 
not  be  included  in  the  same  population  as  the  group  with 
two  AIS  test  sets  (group  2) . 

The  Duncan's  Multiple  Range  test  (Appendix  Jl) 
shows  that  the  average  waiting  time  group  with  two  AIS 
test  sets  (group  2)  and  the  average  waiting  time  group 


62 


with  three  AIS  test  sets  (group  3)  are  included  in  the 
same  subset  population  (subset  1) . 

Research  Question  #3:  The  Practical 
Significance  Issue 

Findings  relative  to  research  question  #3  were  the 
response  surface  (Table  7  and  Appendix  I) ,  the  one-way 
analysis  of  variance  output  (Appendix  J3)  and  the  review 
of  literature  on  the  importance  of  qualifying  quantitative 
generated  answers  to  complex  problems  through  the  use  of 
individual  knowledge  and  experience.  The  response  sur¬ 
face  and  analysis  of  variance  results  indicate  that  the 
average  waiting  time  variable  when  one  test  set  is  avail¬ 
able  is  normally  distributed  with  a  mean  of  130.5  hours 
and  a  standard  error  of  19.3  hours.  The  average  waiting 
time  random  variable  when  two  test  sets  are  available  is 
normally  distributed  with  a  mean  of  12.4  hours  and  a 
standard  error  of  10.3  hours.  The  average  waiting  time 
random  variable  when  three  AIS  test  sets  are  available  is 
normally  distributed  with  a  mean  of  1.2  hours  and  a  stan¬ 
dard  error  of  0.5  hours.  A  review  of  the  literature  on 
the  use  of  purely  quantitative  decision  support  systems 
(DSS)  reminds  the  decision  maker  that  "a  DSS  supports  and 
does  not  replace  the  manager  [21:58]."  Furthermore,  the 
literature  reveals  that: 

This  emphasis  on  enhancement  of  decision  making 
exploits  those  aspects  of  computers  and  analytical 
techniques  that  are  appropriate  for  the  problem  and 
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leaves  the  remainder  to  the  manager.  Most,  if  not  all, 
of  manager's  key  decisions  tend  to  be  fuzzy  problems, 
not  well  understood  by  them  or  the  organization,  and 
their  personal  judgement  is  essential.  It  is  not  pos¬ 
sible  to  think  of  a  computer  system  replacing  managers 
or  most  of  their  decisions.  .  .  .  The  key  point  for 
a  DSS  is  to  support  or  enhance  the  manager's  decision¬ 
making  ability  [21:58]. 

Therefore,  there  is  evidence  to  indicate  that  the 
mean  waiting  time  in  the  AIS  could  be  statistically  sig- 
nicantly  decreased  by  producing  two  sets;  however,  the 
procurement  of  three  test  sets  does  not  statistically 
significantly  reduce  the  average  waiting  time  in  the  queue 
of  the  AIS  work  center.  On  the  other  hand,  practical  sig¬ 
nificance  of  the  reduction  in  average  waiting  time  must  be 
determined  by  the  individual  decision  maker. 


Summary 

The  findings  presented  in  this  chapter  were  cor¬ 
related  to  the  research  questions  that  were  developed  in 
Chapter  I.  Table  9  is  a  summary  of  this  correlation. 
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CORRELATION  OF  RESEARCH  QUESTIONS  AND  FINDINGS 
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CHAPTER  IV 


CONCLUSIONS  AND  RECOMMENDATIONS 

Introduction 

Several  conclusions  can  be  formulated  as  a  result 
of  the  Q-GERT  simulation  of  the  F-16  LRU  repair  cycle 
process.  In  addition  to  the  conclusions  drawn  from  the 
results  of  the  simulation  output,  there  are  also  conclu¬ 
sions  which  can  be  postulated  as  a  result  of  the  statis¬ 
tical  analysis  of  the  F-16  raw  data.  Several  conclusions 
led  to  recommendations  for  F-16  logistics  managers,  and 
may  be  useful  when  planning  for  support  equipment  (SE) 
requirements  during  weapon  systems  acquisitions  or  when 
studying  areas  from  Air  Force  maintenance  data  collection 
systems.  Finally,  the  research  raised  some  questions 
which  were  not  within  the  scope  of  this  experiment  and 
which  should  be  studied  further  by  future  logistics  mana¬ 
gers  or  students.  Thus,  this  chapter  identifies  conclu¬ 
sions,  recommendations,  and  additional  research  require¬ 
ments.  The  conclusions  and  recommendations  will  be 
summarized  in  the  framework  of  the  research  questions. 
Finally,  the  thesis  will  be  summarized. 
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Conclusions 

Conclusions  were  reached  by:  (1)  a  statistical 
analysis  of  F-16  real-world  LRU  failure,  test,  and  repair 
data;  (2)  a  statistical  analysis  of  the  results  of  the 
Q-GERT  generated  LRU  awaiting  maintenance  times  as  the 
number  of  AIS  sets  was  varied;  and  (3)  a  practical  evalua¬ 
tion  of  the  results  generated  by  the  Q-GERT  simulation 
model . 

Research  Question  #1:  Character¬ 
ization  of  Arrival  and  Service 
Random  Variables 

Conclusion  #1  was  reached  through  a  statistical 
analysis  of  the  raw  data.  The  condescriptive  statistical 
analysis  and  histogram  of  the  F-16  UHF  R/T  LRU  failure  data 
resulted  in  the  conclusion  that  the  failure  rate  random 
variable  was  exponentially  distributed  with  a  mean  of  6.6 
hours  and  a  maximum  value  of  70.0  hours.  It  was  concluded 
that  the  average  time-to-test  the  F-16  UHF  R/T  was  3.5 
hours  and  that  testing  time  was  lognormally  distributed 
with  a  standard  deviation  of  2.2  hours.  Time-to-repair  the 
UHF  R/T  was  also  concluded  to  be  lognormally  distributed 
with  a  mean  of  8.1  hours  and  a  standard  deviation  of  6.9 
hours.  Ultimately,  it  was  concluded  that  the  important 
arrival  rate  characteristic  (as  represented  by  the  failure 
rate)  and  the  service  rate  characteristic  (as  represented 


by  the  test  and  repair  rates)  for  the  queueing  model  of 
the  F-16  LRU  repair  cycle  could,  indeed,  be  estimated. 

Research  Question  #2;  Relationship 
Between  AIS  Test  Sets  and  LRU 
Waiting  Time 

The  hypothesis  that  the  mean  waiting  time  in  the 
AIS  queue  was  the  same,  regardless  of  the  number  of  test 
sets,  was  concluded  to  be  false.  An  analysis  of  the 
response  surface  mean  waiting  time  in  the  AIS  queue, 
generated  by  the  Q-GERT  simulation  model,  revealed  that 
mean  waiting  time  was  not  the  same  when  the  number  of  test 
sets  was  increased  from  one  to  two  to  three.  Therefore, 
the  theory  that  average  LRU  waiting  time  is  independent 
of  the  number  of  AIS  test  sets  was  rejected  and  it  was 
concluded  that  there  was  a  difference  in  mean  waiting  time 
if  one,  two,  or  three  test  sets  were  procured  to  support 
the  F-16  AIS. 

Since  the  theory  that  average  LRU  waiting  time 
and  the  number  of  AIS  test  sets  are  independent  was 
rejected,  two  subtheories  were  formulated.  First,  it  was 
theorized  that  the  significant  reduction  occurred  when  the 
second  test  set  was  added.  Second,  it  was  theorized  that 
the  significant  reduction  occurred  with  the  third  test  set. 
These  theories  were  tested  by  determining  if  the  mean 
waiting  time  in  the  AIS  queue  was  reduced  with  two  test 
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sets  but  not  with  three,  or  if  the  reduction  occurred  with 
the  addition  of  the  third  test  set  but  not  with  the  addi¬ 
tion  of  the  second  test  set.  As  a  result  of  the  statisti¬ 
cal  analysis  of  the  Q-GERT  generated  response  surface,  it 
was  concluded  that  a  statistically  significant  reduction  in 
AIS  queue  waiting  time  occurred  when  two  test  sets  were 
available;  however,  the  reduction  was  not  statistically  sig¬ 
nificant  when  there  were  three  test  sets  available.  There¬ 
fore,  the  procurement  of  two  AIS  test  sets  will  statis¬ 
tically  significantly  reduce  LRU  waiting  time  in  the  AIS; 
however,  the  procurement  of  three  AIS  test  sets  will  not 
statistically  significantly  reduce  AIS  queue  waiting  time. 

Research  Question  #3 :  The  Practical 
Significance  Issue 

The  statistical  analysis  of  the  response  surface 
indicates  there  is  a  significant  difference  in  mean  waiting 
time  between  one  and  two  AIS  test  sets  but  not  between  two 
and  three  AIS  test  sets.  While  statistically  significant, 
a  logistics  manager  might  be  interested  in  the  actual 
numbers.  For  example,  in  the  case  where  the  choice  was 
between  one  and  two  test  sets,  the  mean  waiting  time  for 
one  is  130.5  hours  and  the  mean  for  two  is  12.4  hours. 

The  difference  of  approximately  118  hours  on  the  average 
is  significant  at  the  .01  level.  However,  the  significance 
must  also  be  weighed  against  other  criteria  which  the 
decision  maker  may  establish.  If  the  decision  maker 
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estimated  that  each  average  reduction  in  LRU  waiting  time 
would  save  $10.00  per  hour,  then  the  savings  as  a  result 
of  increasing  the  number  of  AIS  test  sets  from  one  to  two 
would  be  approximately  $1,180  per  month.  As  a  result,  the 
decision  maker  could  use  the  estimated  savings  as  a  "break¬ 
even  point"  when  deciding  whether  or  not  to  add  the  addi¬ 
tional  test  set.  If  the  cost  of  the  additional  test  set 
was  less  than  or  equal  to  $1,180  per  month,  the  test  set 
should  probably  be  added.  If  the  costs  were  greater  than 
$1,180  per  month,  the  decision  should  be  made  based  on  a 
determination  of  the  significance  of  the  118  hour  reduc¬ 
tion  in  LRU  waiting  time.  The  increase  in  sortie  genera¬ 
tion  or  aircraft  available,  for  example,  might  warrant 
the  addition  of  the  second  test  set  even  though  it  costs 
more  than  $1,180  per  month.  In  the  case  where  the  choice 
was  between  two  and  three  test  sets,  the  mean  for  two  is 
12.4  hours  with  a  standard  error  of  10.3  and  the  mean  for 
three  is  1.2  hours  with  a  standard  error  of  0.5.  The  dif¬ 
ference  of  approximately  11  hours,  on  the  average,  is 
statistically  insignificant  at  the  .01  level;  therefore,  pro¬ 
curement  of  a  third  AIS  test  set  would  not  significantly 
reduce  LRU  waiting  time.  This  data  must  be  weighed  in 
terms  of  spares  availablity,  mission  criticality  and  other 
operational  and  logistics  commitments.  Thus,  it  was  con¬ 
cluded  that  the  results  of  the  simulation  experiment  must 
be  evaluated  in  accordance  with  the  decision  maker's 
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knowledge,  experience,  and  practical  significance  levels. 

In  this  case,  had  the  decision  maker  established  a  signifi¬ 
cant  reduction  of  waiting  time  as  meeting  practical  sig¬ 
nificance  requirements,  then  the  decision  might  be  to 
procure  the  second  test  set,  but  not  the  third. 

Recommendations 

Research  Question  #1;  Character¬ 
ization  of  Arrival  and  Service 
Random  Variables 

As  a  result  of  the  statistical  analysis  of  the 
F-16  LRU  real-world  raw  data,  it  is  recommended  that  F-16 
logistics  managers  use  statistical  techniques  to  analyze 
real-world  maintenance  data.  Determination  of  probability 
distributions  and  estimated  parameters  to  characterize 
those  distributions  would  increase  the  F-16  logistics  mana¬ 
gers's  knowledge  of  key  variables  in  the  F-16  repair  cycle 
process  and  would  be  necessary  to  define  arrival  and  ser¬ 
vice  system  characteristics  in  the  Q-GERT  model. 


Research  Question  #2:  Relationship 
Between  AIS  Test  Sets  and  LRU 
Waiting  Time 

As  a  result  of  the  Q-GERT  simulation  output,  it  is 
specifically  recommended  that  two  AIS  test  sets  be  identi¬ 
fied  to  support  the  F-16  if  average  waiting  time  in  the  AIS 
queue  is  to  be  statistically  significantly  reduced.  Cur¬ 
rently,  one  avionics  intermediate  shop  has  three  AIS  test 
sets  while  others  have  two.  Since  the  additional  (third)  AIS 
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test  set  does  not  statistically  significantly  reduce  wait¬ 
ing  time  in  the  AIS  queue,  it  is  recommended  that  two  test 
sets  be  considered  as  the  standard  procured  for  all  F-16 
Avionics  Intermediate  Shops.  These  recommendations  are 
further  qualified  in  the  recommendation  for  research  ques¬ 
tion  #3. 

Research  Question  #3;  The  Practical 
Significance  Issue 

Based  on  a  qualitative  review  of  the  average  wait¬ 
ing  times,  as  the  number  of  test  stations  was  varied,  and 
a  critical  review  of  the  DSS  literature,  it  is  recommended 
that  practical  significance  thresholds  be  established  in 
addition  to  formal  statistical  significance  requirements 
when  evaluating  DSS  outputs.  The  ultimate  decision  must 
be  made  by  the  DOD  logistics  managers  based  upon  the  quanti¬ 
tative  results  from  the  DSS  and  on  practical  significance 
criteria  generated  by  the  decision  makers.  The  decision 
maker's  knowledge  and  experience  are  the  key  to  generating 
the  practical  significance  criteria.  The  key  point  is 
that  the  DSS  must  be  used  to  support,  and  not  to  make,  the 
final  decision. 

Review  of  Conclusions  and  Recommendations 

A  summary  of  the  research  questions  and  the  result¬ 
ing  conclusions  and  recommendations  is  shown  in  Tables  10 
and  11. 
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Should  practical  significance  3.  Results  of  simulation  must  be  evalu- 

levels  be  used  to  evaluate  model  ated  using  decision  maker's  knowledge, 

results?  experience,  and  practical  significance 

levels. 


TABLE  11 
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Additional  Research  Requirements 

First,  although  the  thesis  developed  a  Q-GERT 
simulation  model  which  could  be  used  to  model  the  entire 
F-16  LRU  repair  cycle  process,  only  the  UHF  R/T  LRU  data 
was  used  in  the  experiment.  Therefore,  further  research 
should  be  conducted  using  the  other  F-16  LRUs  to  determine 
if  the  findings  and  conclusions  herein  are  representative 
of  the  entire  F-16  LRU  repair  cycle. 

Second,  in  addition  to  average  waiting  time  in 
the  AIS  queue,  the  impact  on  other  response  variables,  such 
as  aircraft  availability,  sortie  generation,  etc.,  should 
be  determined  by  using  the  Q-GERT  model  and  by  varying  the 
number  of  AIS  test  sets.  Therefore,  further  research  with 
other  response  variables  is  recommended. 

Third,  although  the  thesis  has  demonstrated  the 
applicability  of  the  Q-GERT  model  in  the  acquisition  of 
support  equipment,  the  model  could  also  be  used  in  the 
determination  of  the  number  of  spares  required  to  support 
the  F-16.  Instead  of  varying  the  number  of  AIS  test 
sets,  the  number  of  spares  could  be  varied  and  its  impact 
on  selected  response  variables  could  be  measured.  There¬ 
fore,  it  is  recommended  that  research  be  conducted  into 
the  use  of  the  Q-GERT  model  as  an  aid  in  identifying  spares 
to  support  the  F-16 . 

Fourth,  another  area  of  initial  logistics  support 
which  could  be  evaluated  using  the  Q-GERT  model  is 
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training.  Estimates  of  reductions  in  time-to-test  and 
time-to-repair  due  to  changes  in  training  could  be  made 
and  implemented  into  the  Q-GERT  model.  These  changes 
could  then  be  used  to  determine  their  impact  on  selected 
dependent  variables  in  the  F-16  program.  It  is  recommended 
that  further  research  into  the  use  of  Q-GERT  as  a  decision 
aid  in  planning  and  conducting  training  be  undertaken. 

Finally,  cost-benefit  analysis  should  be  conducted 
to  determine  if  the  reduction  in  waiting  time  obtained 
by  procuring  additional  AIS  test  sets  is  worth  the  cost 
of  the  additional  sets. 


Summary 

The  statistical  techniques  applied  30  data 
points  for  a  F-16  RF  LRU  validated  the  assumption  that 
theoretical  distributions  can  be  used  to  describe  the 
time-to-test,  time-to-repair,  and  failure  rate  random 
variables.  In  addition,  the  mean  and  standard  deviations 
of  the  random  variables  can  be  estimated.  The  data 
obtained  in  the  statistical  analysis  was  applied  to  a 
Q-GERT  simulation  model  of  F-16  intermediate  level  repair. 
Although  these  statistical  techniques  were  only  applied 
against  data  on  one  F-16  LRU,  it  is  reasonable  to  assume 
that  these  techniques  could  be  applied  throughout  logis¬ 
tics  support  analysis  of  the  entire  F-16  program. 
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The  Q-GERT  simulation  experiment  demonstrated  the 
use  of  systems  theory,  queueing  techniques,  and  Q-GERT 
simulation  as  a  decision  support  tool  for  Air  Force  logis¬ 
tics  managers.  The  methodology  of  the  system  science  para¬ 
digm  and  its  use  in  development  of  a  simulation  model  was 
illustrated  and  validated  by  statistical  techniques. 

Three  research  questions  were  developed  and  answered  by 
using  simulation  to  model  the  real-world  repair  cycle  pro¬ 
cess  of  F-16  LRUs.  The  hypothesis  that  the  number  of  AIS 
automated  test  sets  does  not  affect  average  LRU  waiting 
time  in  the  intermediate  maintenance  shop  was  rejected. 

It  was  further  concluded  that  F-16  acquisition  logistics 
managers  should  consider  the  procurement  of  two  AIS  test 
sets  to  support  the  F-16,  but  procurement  of  three  AIS 
test  sets  would  not  statistically  significantly  reduce  LRU 
waiting  time  in  the  AIS.  These  statistical  conclusions, 
however,  were  qualified  by  reminding  the  reader  that  prac¬ 
tical  significance  requirements  must  also  be  considered 
when  evaluating  the  results  of  a  decision  support  system. 
Recommendations  for  the  use  of  systems  theory,  queueing 
techniques,  and  simulation  to  evaluate  acquisition  logis¬ 
tics  decisions  were  outlined  and  opportunities  for  further 
research  were  presented.  Thus,  it  was  demonstrated  that 
theoretical  paradigms  and  statistical  tools  can  be  used 
as  effective  decision  support  systems  in  the  real-world 
decision-making  process  of  determining  life  cycle  logistics 
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support  requirements.  With  the  current  emphasis  on 
increased  defense  spending  and  the  use  of  computers  in 
the  Department  of  Defense,  it  is  imperative  that  Air  Force 
decision  makers  evaluate  alternatives  as  comprehensively 
as  possible.  The  use  of  the  methodology  presented  in  this 
thesis  should  be  considered  as  a  way  of  improving  the 
multi-million  dollar  decision-making  tasks  of  Air  Force 
logistics  managers. 
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This  appendix  gives  the  commonly  used  abbrevia¬ 
tions  or  acronyms  involved  with  the  acquisition  and  logis¬ 
tics  support  of  the  F-16  weapon  system,  and  the  terminol¬ 
ogy  of  queueing  theory.  Also  included  in  this  appendix 
is  the  symbology — giving  the  commonly  used  statistical 
symbols  and  the  Q-GERT  symbology  used  in  the  Q-GERT  simula¬ 
tion  model. 


Abbreviations  and  Acronyms 


AFB 

AFIT 

AIS 

ANOVA 

ATE 

ATE-AIS 

CDS 

Cl 

CND 

CONUS 

DI 

DOD 

DRC 

DSS 

I-LEVEL 


-  Air  Force  Base 

-  Air  Force  institute  of  Technology 

-  Avionics  Intermediate  Shop 

-  Analysis  of  Variance 

-  Automatic  Test  Equipment 

-  Automatic  Test  Equipment-Avionics 
Intermediate  Shop 

-  Centralized  Data  System 

-  Control /Indicators  Test  Station  of  AIS 

-  Cannot  Duplicate 

-  Continental  United  States 

-  Display/ Indicators  Station  of  AIS 

-  Department  of  Defense 

-  Dynamics  Research  Corporation 

-  Decision  Support  System 

-  Intermediate  Level  of  Maintenance 
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Abbreviations — Continued 
LOGAIR  -  Logistics  Air 

LRU  -  Line  Replaceable  Unit 

MDC  -  Maintenance  Data  Collection  System 


Mean  Arrival  Rate  -  The  expected  number  of  units  arriving 

or  entering  the  system  in  a  given 
period  of  time 

Mean  Service  Rate  -  The  expected  number  of  units  that  can 

be  serviced  by  one  server  in  a  given 
period  of  time 


Operating 

Characteristics  -  The  performance  characteristics  of  a 

waiting  line  such  as  average  units  in 
system,  average  size  of  the  queue,  and 
average  waiting  time  in  queue 

PP  -  Pneumatic  Processor  Test  Station  of 

AIS 

Q-GERT  -  Queueing-Graphical  Evaluation  and 

Review  Techniques  Program 

Queue  -  A  Waiting  Line 

RF  -  Radio  Frequency  test  Station  of  AIS 

RFP  -  Request  for  Proposal 

R/T  -  Receiver/Transmitter  LRU  of  F-16 


SE 

SPO 


-  Support  Equipment 

-  Systems  Program  Office 

-  Ultra-High  Frequency 


UHF 


Alternate  Hypothesis 
Null  Hypothesis 
Mean 
Equals 

Does  Not  Equal 
Delta,  denoting  change 


Rf  is  the  number  of  incoming  trans¬ 
actions  required  to  release  the  node 
for  the  first  time. 

Rs  is  the  number  of  incoming  trans¬ 
actions/  required  to  release  the  node  for 
all  subsequent  times. 

C  is  the  criterion  for  holding  the 
attribute  set  at  a  node. 

S  is  the  statistics  collection  type 
or  marking. 

#  is  the  node  number. 

indicates  deterministic  branching 
from  the  node. 

indicates  probabilistic  branching 
from  the  node. 

I  is  the  initial  number  of  transac¬ 
tions  at  the  Q-node. 

M  is  the  maximum  number  of  transac¬ 
tions  permitted  at  the  Q-node. 

R  is  the  ranking  procedure  for  order¬ 
ing  transactions  at  the  Q-node. 

#  is  the  Q-node  number. 

Pointer  to  a  source  node  or  from  a 
sink  node. 


Symbols — Continued 


1 

IP) 

D,PS) 

Li 

© 

P  is  the  probability  of  taking  the 
activity  (only  used  if  probabilistic 
branching  from  the  start  node  of  the 
activity  is  specified) . 

D  is  the  distribution  or  function  type 
from  which  the  activity  time  is  to  be 
determined. 

PS  is  the  parameter  set  number  (or 
constant  value)  where  the  parameters 
for  the  activity  time  are  specified. 

#  is  the  activity  number. 

N  is  the  activity  of  parallel  servers 
associated  with  the  activity  (only 
used  if  the  start  node  of  the  activity 
is  a  Q-node) . 


Concept:  Value  Assignment 

-  A  is  the  attribute  number  to  which  a 
value  is  to  be  assigned;  if  A+  is  spe¬ 
cified,  add  value  to  attribute  A; 
if  A-  is  specified,  subtract  value  from 
attribute  A. 


D  is  the  distribution  or  function  type 
from  which  assignment  value  is  to  be 
determined. 


PS  is  the  parameter  set  number. 


Concept:  Queue  Ranking 

-  R  is  the  ranking  procedure  for  order¬ 
ing  transactions  at  the  Q-node.  R  can 
be  specified  as  F  +  FIFO;  L  LIFO; 

B/i  -*■  Big  value  of  attribute  i. 

S/i  Small  value  of  attribute  i.  If 
i=M,  ranking  is  based  on  mark  time. 


Concept:  Conditional,  Take-First 
Branching 

j  indicates  conditional-take  first 
\s  branching  from  the  node. 
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Symbol s  — Continued 

Concept:  Condition  Specification  for 
Branch 


(C)  (D/PS)  ^ 


-  C  is  the  condition  specification  for 
taking  the  activity. 

Concept:  Attribute  Based  Probabilistic 
Branching 


-  If  P  <  1.0,  P  is  the  probability 
of  taking  the  activity. 

If  P  >  1,  P  is  an  attribute  number. 


Concept:  Selector  node  or  S-node 

-  QSR  is  the  queue  selection  rule  for 
routine  transactions  to  or  from 
Q-nodes . 

SSR  is  the  server  selection  rule  for 
deciding  which  server  to  make  busy  if 
a  choice  exists. 

#  is  the  S-node  number. 


Concept:  Routing  Indicator 

-  Routing  indicator  for  transaction  flow 
to  or  from  Q-nodes  to  S-nodes  or 
Match  nodes. 
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APPENDIX  B 

F-16  SYSTEMS  PROGRAM  OFFICE  MAINTENANCE  DATA 


I— I-  ... 


Appendix  B,  F-16  Systems  Program  Office  Maintenance 
Data,  contains  direct  CDS  output  for  63BA0,  RF  station 
receiver/ transmitter  including:  the  Job  Control  number, 
column  one;  the  maintenance  action  start  time,  column  two; 
the  maintenance  action  close-out  time,  column  three;  the 
date  the  maintenance  action  was  recorded,  column  four;  and 
the  action  taken  code,  column  five. 


JCN 

START  TIME 

END  TIME 

DATE 

ACTION  TAKEN 

2949717 

9.00 

9.30 

801020 

C 

2949427 

12.00 

15.30 

801022 

C 

3153807 

8.00 

11.00 

801112 

C 

3209413 

12.00 

15.35 

801117 

C 

3389491 

15.40 

18.30 

801204 

C 

3524003 

19.30 

21.00 

801217 

C 

0054000 

13.30 

15.30 

810105 

C 

0054000 

15.30 

19.00 

810105 

C 

0054000 

18.00 

19 . 30 

810105 

C 

0216463 

13.00 

16.00 

810122 

C 

0336503 

14.00 

22.00 

810202 

C 

0339751 

16.15 

19.30 

810202 

C 

0335048 

17.30 

20.30 

810202 

C 

0362830 

16.00 

19.30 

810205 

C 

0369608 

13.30 

21.30 

810206 

C 

0369608 

9.00 

9.30 

810212 

C 

0459601 

13.30 

16.00 

810217 

c 

0499421 

20.30 

23.30 

810219 

c 

0649768 

10.15 

17.50 

810309 

c 

0914050 

19.00 

20.30 

810401 

c 

0919517 

13.00 

15.40 

810407 

c 
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JCN 

STATE  TIME 

END  TIME 

DATE 

0979771 

22.30 

22.50 

810407 

0989614 

23.00 

23.30 

810408 

0993813 

16.00 

20.30 

810410 

1046156 

16.30 

21.00 

810415 

1066576 

20.30 

22.30 

810416 

1059517 

5.45 

8.00 

810417 

1036663 

12.30 

15.00 

810417 

1106117 

16.4  5 

18.15 

810421 

1129786 

20.00 

24.00 

810428 

1279750 

3.00 

7.00 

810508 

1264014 

.05 

7.00 

810512 

1056650 

11.00 

15.30 

810515 

2949427 

15.30 

22.30 

801022 

2949427 

8.00 

16.00 

801023 

2949427 

18.00 

19.10 

801023 

2949717 

7.00 

7.45 

801028 

3153807 

12.00 

16.00, 

801112 

3209413 

15.40 

20.00 

801117 

3209413 

12.00 

16.00 

801118 

3209413 

16.00 

21.00 

801118 

3389491 

9.30 

11.30 

801206 

3524003 

22.30 

24.00 

801217 

0054000 

20.15 

23.00 

810105 

0054000 

9.05 

15.00 

810106 

0054400 

13.50 

16.00 

810108 

0054400 

16.00 

23.45 

810108 

0054400 

7.40 

12.15 

810109 

0216463 

16.15 

23.00 

810122 

0216463 

.05 

7.00 

810123 

0216463 

5.00 

7.00 

810127 

0216463 

7.00 

11.30 

810127 

0336503 

22.30 

23.30 

810202 

JCN 

START  TIME 

END  TIME 

DATE 

ACTION  TAKEN 

0335048 

23.00 

24.00 

810202 

F 

0335048 

.05 

4.00 

810203 

F 

0362830 

23.00 

24.00 

810205 

F 

0339751 

9.00 

12.00 

810206 

F 

0362830 

24.00 

5.30 

810206 

F 

0339751 

16.00 

23.00 

810211 

F 

0369608 

13.00 

14.30 

810212 

F 

0369608 

16.00 

17.30 

810212 

F 

0369608 

16.00 

18.00 

810217 

F 

0459601 

16.00 

16.30 

810217 

F 

0459601 

18.00 

21.00 

810217 

F 

0369608 

22.15 

6.15 

810717 

F 

0369608 

7.50 

15.00 

810218 

F 

0369608 

16.00 

17.00 

810218 

F 

0499421 

7.30 

15.30 

810220 

F 

0499421 

15.30 

18  .00 

810220 

F 

0499421 

15.00 

16.30 

810221 

F 

0499421 

12.00 

18.30 

810222 

F 

0339751 

21.00 

21.4  5 

810303 

F 

0649768 

11.00 

16.00 

810312 

F 

0649768 

19.00 

19.30 

810312 

F 

0649768 

1.00 

1.30 

810313 

F 

0649768 

7.00 

8.00 

810313 

F 

0339751 

8.00 

9.00 

810324 

F 

0339751 

10.30 

16.00 

810325 

F 

0339751 

16.00 

19.15 

810325 

F 

0914050 

22.30 

24.00 

810401 

F 

0914050 

7.00 

8.00 

810402 

F 

0919517 

15.40 

16.15 

810407 

F 

0979771 

16.00 

21.00 

810408 

F 

0989614 

4.30 

7.10 

810409 

F 

0989614 

7.10 

8.50 

810409 

F 

0993813 

16.00 

16.30 

810415 

F 
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JCN 

START  TIME 

END  TIME 

DATE 

ACTION  TAKEN 

0993813 

17.30 

22.30 

810415 

F 

1066576 

.05 

3.00 

810417 

F 

1046156 

7.00 

12.00 

810417 

F 

1059517 

15.30 

16.15 

810417 

F 

0979771 

16.30 

17.00 

810417 

F 

1046156 

8.00 

15.00 

810420 

F 

1036663 

15.00 

15.30 

810420 

F 

1036663 

15.30 

19.00 

810420 

F 

0979771 

16.15 

18.35 

810422 

F 

1059517 

23.45 

24.00 

810428  • 

F 

1059517 

13.15 

16.30 

810429 

F 

1129786 

16.00 

23.00 

810429 

F 

1129786 

17.00 

22.00 

810430 

F 

1106117 

16.00 

22.00 

810505 

F 

1264014 

7.00 

8.00 

810512 

F 

1279750 

12.30 

18.00 

810512 

F 

1056650 

15.30 

23.00 

810515 

F 

1056650 

14.00 

15.30 

810518 

F 

1056650 

15.30 

23.00 

810518 

F 

1056650 

9.00 

14.30 

810527 

F 

1056650 

18.00 

23.30 

810527 

F 
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APPENDIX  C 
FAILURE  RATE  DATA 
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The  failure  rate  data  of  Appendix  C  shows  the  F-16 
mean  time  between  maintenance  actions  for  work  unit  code 
63BA0,  the  UHF  receiver/ transmitter.  The  data,  generated 
by  the  CDS  at  the  F-16  SPO,  shows  the  dates  (the  months 
from  June  1979  through  September  1981)  with  the  monthly 
calculated  mean  time  between  maintenance  actions  and  the 
cumulative  figures  for  mean  time  between  maintenance 
actions. 


F-16  MTBMA  FOR  WUC:  63BA0  NOUN:  RECIV-TRANS  UHF 


MONTHLY 

CUMULATIVE 

DATE 

MTBMA 

MTBMA 

7906 

94.83 

46.33 

7907 

386.80 

61.81 

7908 

60.05 

61.43 

7909 

223.00 

77.07 

7910 

292.00 

96.03 

7911 

106.89 

98.30 

7912 

176.16 

106.41 

8001 

268.18 

118.86 

8002 

131.89 

120.96 

8003 

138.40 

123.59 

8004 

95.90 

117.87 

8005 

43.66 

93.13 

8006 

60.14 

86.61 

8007 

123.45 

90.28 

8008 

130.25 

93.89 

8009 

140.94 

97.22 
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DATE 

MONTHLY 

MTBMA 

CUMULTATIVE 

MTBMA 

8010 

66.96 

91.83 

8011 

182.84 

96.83 

8012 

120.27 

98.55 

8101 

95.45 

98.27 

8102 

96.34 

98.09 

8103 

153.52 

101.88 

8104 

100.88 

101.79 

8105 

110.88 

102.52 

8106 

171.92 

106.38 

8107 

302.64 

113.27 

8108 

220.53 

114.45 

8109 

122.63 

114.97 
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APPENDIX  D 

CONDESCRIPTIVE  STATISTICS  OF  FAILURE  DATA 
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Appendix  D,  Condescriptive  Statistics  of  Failure 
Data,  shows  the  final  computer  output  of  the  condescrip¬ 
tive  statistics  for  the  F-16  SPO  failure  data  from 
Appendix  C. 


MEAN 

150.621 

STD  ERROR 

15.487 

STD  DEV 

81.949 

VARIANCE 

6715.614 

KURTOSIS 

1.410 

SKEWNESS 

1.276 

RANGE 

343.140 

MINIMUM 

43.660 

MAXIMUM 

386.800 

SUM 

4217.400 

I 
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APPENDIX  E 

CONDESCRIPTIVE  STATISTICS,  HISTOGRAMS,  AND 
GOODNESS-OP-FIT  TESTS 
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Appendix  E  is  divided  into  three  parts.  Appen¬ 
dix  E-l  is  computer-generated  condescriptive  statistics 
and  histogram  of  the  interarrival  time  data  of  Table  3. 
Appendix  E2  is  computer-generated  condescriptive  sta¬ 
tistics,  histogram,  and  goodness-of -f it  test  of  the 
test  times  as  shown  in  Table  4.  Appendix  E3  is  computer¬ 
generated  condescriptive  statistics,  histogram,  and 
goodness-of-f it  test  of  the  repair  times  as  shown  in 


Table  4. 


APPENDIX  El 


INTERARRIVAL  TIME  CONDESCRIPTIVE  STATISTICS 
AND  HISTOGRAM 
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VARIABLE 

IAT 

MEAN 

VARIANCE 

RANGE 

6.635 

114.620 

69.460 

STD  DEV 

SKEWNESS 

MAXIMUM 

10.706 

4.451 

69.580 

STD  ERROR 

KURTOSIS 

MINIMUM 

1.514 

24.696 

0.120 

SUM  331.740 

VALID  OBSERVATIONS  -  50 
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APPENDIX  E2 

CONDESCRIPTIVE  STATISTICS,  HISTOGRAM,  AND 
GOODNESS-OF-FIT  TESTS  FOR  TIME-TO-TEST 
RANDOM  VARIABLE 
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KOUCGOROV-SMIFNOV  GOODNESS  OF  FIT  TEST 


TEST  DIST.  -  NORMAL  (MEAN  ■  5.1145  STD.  DEV.  =  0.7826) 


CASES 

MAX  (ABS  DIPT) 

PRX(+  DIFF) 

MAX  (-DIFF) 

30 

0.1806 

0.1015 

-0.1806 

K-S  Z 

2-TAILED  P 

0.989 

0.282 

Time  to  Test,  Lilliefors  Test 

H  :  logarithms  of  time-to-test  random  variables  follow  a 
°  normal  distribution;  time-to-test  variables  are 
lognormally  distributed. 

H  :  logarithms  of  time-to-test  values  are  not  normally 
a  distributed;  time-to-test  is  not  lognormally  dis¬ 
tributed. 

Since  0.1806  (MAX  ABS  DIFF)  <  .187  (n=30,  a*. 01  from  Lilliefors  Table)  . 

the  null  hypothesis  that  the  time-to-test  is  lognomally  distributed 
cannot  be  rejected. 
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APPENDIX  E3 

CONDESCRIPTIVE  STATISTICS,  HISTOGRAM,  AND 
GOODNESS-OF-FIT  TESTS  FOR  TIME-TO-REPAIR 
RANDOM  VARIABLE 
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VARIABLE  REPAIR 


MEAN 

8.11  hrs. 

SID  ERROR 

75.590 

STD  DEV 

6.9  hrs. 

VARIANCE 

171415.402 

KURTOSIS 

0.710 

SKEWNESS 

1.178 

RANGE 

1610.000 

MAXIMUM 

45.000 

MAXIMJM 

1655.000 

SUM  14590.000 

VALID  OBSERVATIONS  -  30  MISSING  OBSERVATIONS  -  0 
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KDLMOQOROV-SMIRNOV  GOODNESS  OF  FIT  TEST 


TEST  DIST.  -  NORMAL  (MEAN  =  5.8058  STD.  DEV.  =  0.9429) 


CASES 

MAX (ABS  DIFF) 

MAX (+DIFF) 

MAX ( -DIFF) 

30 

0.0940 

0.0661 

-0.0940 

K-S  Z 

2-TAILED  P 

0.515 

0.954 

Time  to  Repair,  Lilliefors  Test 

H  :  Logarithms  of  time-to-repair  randan  variables  follow 
°  a  normal  distribution;  time-to-repair  variables  are 
lognormal ly  distributed. 

H  :  Logarithms  of  time-to-repair  random  variables  do  not 
follow  a  normal  distribution;  time  to  repair  variables 
are  not  lognormally  distributed. 

Since  .0940  (MAX  ABS  DIFF)  <  .187  (n=30,  a*.  01  from  Lilliefors  Table) 

the  null  hypothesis  that  the  time-to-repair  is  lognormally  distributed 
cannot  be  rejected. 
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APPENDIX  F 

Q-GERT  SIMULATION  MODEL  PROGRAM 
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Appendix  F,  Q-GERT  Simulation  Model  Program,  con¬ 
tains  the  computer  input  to  run  the  Q-GERT  simulation 
program . 


***  INPUT  CARDS  *** 

GEN , BRY  SON , AIS , (10) 720 , 12 ,C , 0 , 2* 
QUE, 5/NELLIS, 99, 100, D,F* 

QUE, 40/HILL, 99, 100, D,F* 

QUE , 70 /MACD ILL ,  4  9 , 50  ,  D ,  F* 

ACT, 5,10, EX, 1 , 2/N-TOSHOP , 1* 

ACT, 40 , 4  5, EX, 1 , 20/H-TOSHOP, 1* 

ACT , 70 , 7  5 , EX , 1 , 4  O/M-TOSHOP , 1* 

SEL, 2/TO-BASES ,LRC, (7) 5,40, 70* 

REG, 10, 1,1, D* 

VAS ,10,1, UN , 2* 

ACT, 10, 11, CO, 0. ,3,1* 

REG, 45, 1 , 1 , D* 

VAS, 45,1, UN, 2* 

ACT, 45, 46, CO, 0. ,21,1* 

REG, 75, 1,1, D* 

VAS, 75,1, UN, 2* 

ACT, 75, 76, CO, 0. ,41,1* 

REG, 11 , 1 , 1 , F* 

REG, 46 , 1 , 1 ,F* 

REG, 76 , 1 , 1 , F* 

ACT, 11 , 12 ,C° , 0 . , 4 , 1 , (9 ) A1 .LE .0.1* 
ACT, 11, 13, CO, 0. ,5,1, (9 ) A1 .GT. 0 . 1* 
ACT, 46, 47, CO, 0. ,22,1, (9 ) A1 . LE . 0 . 1* 
ACT, 46, 48, CO, 0. ,23,1, ( 9 ) Al . GT . 0 . 1* 
ACT, 76, 77, CO, 0. ,42,1, ( 9 ) Al . LE . 0 . 1* 
ACT, 76, 78, CO, 0. ,43,1, ( 9 ) Al .GT. 0 . 1* 
REG, 12, 1,1, D* 

VAS, 12, 2, LO, 4* 

REG, 13 , 1 , 1 , D* 

VAS ,13,2, LO ,4,2+, LO ,5* 

REG, 47, 1,1, D* 

VAS, 47, 2, LO, 4* 

REG, 48 ,1, 1,D* 

VAS ,  4  8 , 2 , LO , 4 , 2+ , LO , 5* 

REG, 77 , 1 , 1 , D* 

VAS, 77, 2, LO, 4* 

REG, 78,1,1,D* 

VAS ,  78 , 2 ,  LO ,  4 , 2+ ,  LO ,  5* 
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ACT, 12/14 /CO, 0 . , 6 , 1* 

ACT, 13, 14/CO, 0. , 7,1* 

ACT, 47, 49, CO, 0. ,24,1* 

ACT,48,49,CO,0. ,25,1* 

ACT, 77, 79, CO, 0., 44.1* 

ACT, 78, 79, CO, 0. ,45,1* 

QUE, 14,0, ,D,F, (10)15* 

QUE ,49,0, ,D,F, (10) 50* 

QUE ,79,0, , D, F , (10)80* 

RES, 1,2,15* 

RES, 2, 3, 50* 

RES, 3, 2, 80* 

ALL, 15,POR, 1,1, 14/20* 

ALL, 50, POR, 2,1,49/55* 

ALL, 80, POR, 3,1, 79/85* 

QUE, 20,0, , D , F* 

QUE, 55,0, ,D,F* 

QUE, 85, 0, , D,F* 

ACT, 20, 25, AT, 2,8/AIS-N, 2* 

ACT, 55,60 , AT ,2,26 /AIS-H , 3* 

ACT, 85, 90, AT, 2,46/AIS-M, 2* 

FRE, 25 , F, 1 , 1 , 15* 

FRE, 60 , F, 2 , 1 , 50* 

FRE, 90, F, 3, 1,80* 

ACT, 25 , 5 ,CO , 1 . , 9/RET-N-FL, 1 , (9 ) A1 .GE . 0 . 0 2* 
ACT, 25, 95, CO, 48 . , 10/N-NRTS, 1, (9) A1.LT.0 .02* 
ACT, 60,40 ,CO, 1 . , 27/RET-H-FL, 1 , ( 9 ) A1 .GE . 0 . 02* 
ACT, 60 , 95, CO , 2 , 28/H-NRTS , 1 , (9) Al .LT.O . 02* 
ACT, 90 , 70 , CO, 1 . , 4  7/RET-M-FL, 1 , (9 ) Al .GE . 0 . 02* 
ACT, 90, 95, CO, 48. , 48/M-NRTS , 1 , ( 9 ) Al . LT. 0 . 0 2* 
QUE, 95/DEPOT, 0, ,D,F* 

ACT, 9 5, 2, LO, 3, 50/DEPOT ,6* 

PAR, 1,6. 635,0. ,70.* 

PAR, 2, ,0,1.* 

PAR, 3, 14. ,0. ,49.73,11.91* 

PAR, 4, 3. 5,0. ,10.01, 2.17* 

PAR, 5, 8. 11,0. ,28.81,6.9* 

FIN* 
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Appendix  G,  Q-GERT  trace,  gives  a  sampling  of  the 
Q-GERT  output  to  enable  the  user  to  follow,  or  trace,  indi¬ 
vidual  transactions  through  the  Q-GERT  system.  Four  indi¬ 
vidual  trace  sections  have  been  extracted  to  provide  a 
test  that  the  simulation  model  functioned  as  it  was 
designed  to.  Part  I  shows  a  transaction  that  was  repaired 
and  subsequently  returned  to  the  same  base  that  completed 
the  service  activity,  one  trace  from  each  of  the  three 
bases.  Part  II  shows  a  transaction  that  underwent  the  test 
activity  and  was  subsequently  returned  to  the  same  base 
that  completed  the  service  activity,  one  for  each  of  the 
three  bases.  Part  III  shows  transactions  that  were  con¬ 
sidered  not  reparable  this  station  (NRTS) ,  forwarded  to 
the  depot  service  activity  and  subsequently  returned  to  a 
base  activity,  one  trace  from  each  of  the  three  bases. 
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REPAIR  AND  RETURN  TO  BASE  QUEUE  (DIRECT) 


Start 

Node 

End 

Node 

Start 

Time 

End 

Time 

Acty 

# 

Trans 

Number 

Attributes 

1  2 

Nellis 

5 

10 

0.00 

0.06 

2 

1 

0.00 

0.00 

10 

11 

0.06 

0.06 

3 

1 

0.21 

0.00 

11 

13 

0.06 

0.06 

5 

1 

0.21 

0.00 

13 

14 

0.06 

0.06 

7 

1 

0.21 

8.70 

*** 

14 

- 

0.06 

7 

1 

0.21 

8.70 

*** 

20 

- 

0.06 

0 

1 

0.21 

8.70 

20 

25 

0.06 

8.76 

8 

1 

0.21 

8.70 

25 

5 

8.76 

9.76 

9 

1 

0.21 

8.70 

Hill 

40 

45 

0.00 

0.01 

20 

101 

0.00 

0.00 

45 

46 

0.01 

0.01 

21 

101 

0.91 

0.00 

46 

48 

0.01 

0.01 

23 

101 

0.91 

0.00 

48 

49 

0.01 

0.01 

25 

101 

0.91 

11.30 

*** 

49 

- 

0.01 

25 

101 

0.91 

11.30 

*** 

55 

- 

0.01 

0 

101 

0.91 

11.30 

55 

60 

0.01 

11.31 

26 

101 

0.91 

11.30 

60 

40 

11.31 

12.31 

27 

101 

0.91 

11.30 

MacDill 

70 

75 

0.00 

17.88 

40 

201 

0.00 

0.00 

75 

76 

17.88 

17.88 

41 

201 

0.98 

0.00 

76 

78 

17.88 

17.88 

43 

201 

0.98 

0.00 

78 

79 

17.88 

17.88 

45 

201 

0.98 

7.68 

*** 

79 

- 

17.88 

45 

201 

0.98 

7.68 

*** 

85 

- 

17.88 

0 

201 

0.98 

7.68 

85 

90 

17.88 

25.56 

46 

201 

0.98 

7.68 

90 

70 

25.56 

26.56 

47 

201 

0.98 

7.68 
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TEST  AND  RETURN  TO  BASE  QUEUE  (DIRECT) 


Start 

End 

Start 

End 

Acty 

Trans 

Attributes 

Node 

Node 

Time 

Time 

# 

Number 

1  2 

Nellis 


5 

10 

76.86 

94.84 

2 

16 

0.00 

0.00 

10 

11 

94.84 

94.84 

3 

16 

0.09 

0.00 

11 

12 

94.84 

94.84 

4 

16 

0.09 

0.00 

12 

14 

94.84 

94.84 

6 

16 

0.09 

2.71 

*  *  ★ 

14 

- 

94.84 

6 

16 

0.09 

2.71 

20 

- 

94.84 

0 

16 

0.09 

2.71 

20 

25 

94.84 

97.55 

8 

16 

0.09 

2.71 

25 

5 

97.55 

98.55 

9 

16 

0.09 

2.71 

Hill 


40 

45 

188.63 

190.93 

20 

132 

0.00 

0.00 

45 

46 

190.93 

190.93 

21 

132 

0.09 

0.00 

46 

47 

190.93 

190.93 

22 

132 

0.09 

0.00 

47 

49 

190.93 

190.93 

24 

132 

0.09 

1.19 

*** 

49 

- 

190.93 

24 

132 

0.09 

1.19 

*** 

55 

- 

190.93 

0 

132 

0.09 

1.19 

55 

60 

190.93 

192.12 

26 

132 

0.09 

1.19 

60 

40 

192.12 

193.12 

27 

132 

0.09 

1.19 

MacDill 


70 

75 

172.18 

180.22 

40 

237 

0.00 

0.00 

75 

76 

180.22 

180.22 

41 

237 

0.09 

0.00 

76 

77 

180.22 

180.22 

42 

237 

0.09 

0.00 

77 

79 

180.22 

180.22 

44 

237 

0.09 

4.00 

*** 

79 

- 

180.22 

44 

237 

0.09 

4.00 

*** 

85 

- 

247.59 

0 

237 

0.09 

4.00 

85 

90 

247.59 

251.59 

46 

237 

0.09 

4.00 

90 

70 

251.59 

252.59 

47 

237 

0.09 

4.00 
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TEST  AND  NRTS  TO  DEPOT  FOR  REPAIR  AND  RETURN  TO  BASE 


Start 

Node 

End 

Node 

Start 

Time 

End 

Time 

Acty 

# 

Trans 

Number 

Attributes 
1  2 

Hill 

40 

45 

186.37 

188.63 

20 

131 

0.00 

0.00 

45 

46 

188.63 

188.63 

21 

131 

0.01 

0.00 

46 

47 

188.63 

188.63 

22 

131 

0.01 

0.00 

47 

49 

188.63 

188.63 

24 

131 

0.00 

1.89 

*** 

49 

- 

188.63 

24 

131 

0.00 

1.89 

*** 

55 

- 

188.63 

0 

131 

0.01 

1.89 

55 

60 

188.63 

190.52 

26 

131 

0.01 

1.89 

60 

95 

190.52 

192.52 

28 

131 

0.01 

1.89 

*  *  * 

95 

- 

192.52 

28 

131 

0.01 

1.89 

95 

2 

192.52 

196.32 

50 

131 

0.01 

1.89 

★  ** 

2 

- 

196.32 

50 

131 

0.01 

1.89 

70 

75 

505.16 

509.27 

40 

131 

0.01 

1.89 

70 

75 

82.41 

MacDill 

91.40 

40 

217 

0.00 

0.00 

75 

76 

91.40 

91.40 

41 

217 

0.00 

0.00 

76 

77 

91.40 

91.40 

42 

217 

0.00 

0.00 

77 

79 

91.40 

91.40 

44 

217 

0.00 

3.83 

*** 

79 

- 

91.40 

44 

217 

0.00 

3.83 

*** 

85 

- 

124.18 

0 

217 

0.00 

3.83 

85 

90 

124.18 

128.02 

46 

217 

0.00 

3.83 

90 

95 

128.02 

176.02 

48 

217 

0.00 

3.83 

*** 

95 

- 

176.02 

48 

217 

0.00 

3.83 

95 

2 

176.02 

179.17 

50 

217 

0.00 

3.83 

*** 

2 

- 

179.17 

50 

217 

0.00 

3.83 

70 

75 

497.26 

500.52 

40 

217 

0.00 

3.83 

5 

10 

111.28 

Nellis 

113.17 

2 

23 

0.00 

0.00 

10 

11 

113.17 

113.17 

3 

23 

0.02 

0.00 

11 

12 

113.17 

113.17 

4 

23 

0.02 

0.00 

12 

14 

113.17 

113.17 

6 

23 

0.02 

2.22 

*** 

14 

- 

113.17 

6 

23 

0.02 

2.22 

*** 

20 

- 

131.82 

0 

23 

0.02 

2.22 

20 

25 

131.82 

134.03 

8 

23 

0.02 

2.22 

25 

95 

134.03 

182.03 

10 

23 

0.02 

2.22 

*** 

95 

- 

182.03 

10 

23 

0.02 

2.22 

95 

2 

182.03 

184.70 

50 

23 

0.02 

2.22 

*** 

2 

- 

184.70 

50 

23 

0.02 

2.22 

70 

75 

500.52 

501.14 

40 

23 

0.02 

2.22 
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APPENDIX  H 

GOODNESS-OF-FIT  TESTS  AND  A  HISTOGRAM 
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Appendix  H  consists  of  five  parts.  Appendix  HI 
is  a  goodness-of-f it  test  to  validate  lognormal  distribu¬ 
tion  of  Q-GERT  generated  depot  maintenance  times.  Appen¬ 
dix  H2  is  a  goodness-of-f it  test  to  validate  lognormal  dis¬ 
tribution  of  Q-GERT  generated  AIS  repair  times .  Appendix 
H3  is  a  goodness-of-f it  test  to  validate  lognormal  dis- 
^r^bution  of  Q— GERT  generated  AIS  test  times.  Appendix 
H4  is  a  goodness-of-fit  test  to  validate  the  uniform  dis¬ 
tribution  random  number  generator  of  the  Q-GERT  simulation 
program.  Appendix  H5  is  a  histogram  of  the  interarrival 
times  generated  by  the  Q— GERT  simulation  model  to  validate 
that  they  are  exponentially  distributed. 
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APPENDIX  HI 

LILLIEFORS  TEST  OF  Q-GERT  GENERATED 
DEPOT  MAINTENANCE  TIMES 


I 

I 


KOLMOGOROV- SMIRNOV  GOODNESS  OF  FIT  TEST 


TEST  DISTRIBUTION  -  NORMAL  (Mean  =  1.9004,  STD  DEV  =  0.9286) 
CASES  =  6  MAX (ABS  DIFF)  =  0.2287 

K-S  Z  =  0.560  2-TAILED  P  =  0.912 


n=6;  a=.01  Lilliefors  Table  Value  =  .364 

Hq:  Distribution  of  depot  maintenance  times  is 
lognormal;  logarithms  of  depot  maintenance 
are  normally  distributed. 

Ha:  Distribution  of  depot  maintenance  times  is  not 

lognormal;  logarithms  of  depot  maintenance 
times  are  not  normally  distributed. 


Since  .2287  <  .364,  cannot  reject  null  hypothesis  that 
depot  maintenance  times  are  lognormally  distributed. 
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APPENDIX  H2 

LILLIEFORS  TEST  OF  Q-GERT  GENERATED  AIS 
REPAIR  TIMES 


119 


KOLMOGOROV-SMIRNOV  GOODNESS  OF  FIT  TEST 

TEST  DISTRIBUTION  -  NORMAL  (MEAN  =  2.3093,  STD  DEV  =  0.4675) 
CASES  =  87  MAX (ABS  DIFF)  =  0.0570 

K-S  Z  =  0.531  2-TAILED  P  =  0.940 


n=87;  a=.01  Lilliefors  Table  Value  =  .1105 

H  :  Distribution  of  AIS  repair  times  is  lognormal; 
u  logarithms  of  repair  times  are  normally  dis¬ 
tributed. 

H  :  Distribution  of  AIS  repair  times  is  not  log- 
a  normal;  logarithms  of  repair  times  are  not 
normally  distributed. 


Since  .0570  <  .1105,  cannot  reject  null  hypothesis  that 
AIS  repair  times  are  lognormally  distributed. 
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APPENDIX  H3 

LILLIEFORS  TEST  OF  Q-GERT  GENERATED  AIS 
TEST  TIMES 
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KOLMOGOROV- SMIRNOV  GOODNESS-OF-FIT  TEST 


TEST  DISTRIBUTION  -  NORMAL  (MEAN  =  1.1860,  STD  DEV  =  0.5244) 
CASES  =  25  MAX ( ABS  DIFF)  =  0.1077 

K-S  Z  =  0.538  2-TAILED  P  =  0.934 


n=25;  cx=.01  Lilliefors  Table  Value  =  .20 


H  :  Distribution  of  AIS  testing  times  is  log- 
°  normally  distributed;  logarithms  of  testing 
times  are  normally  distributed. 

H  :  Distribution  of  AIS  testing  times  is  not  log- 
a  normally  distributed;  logarithms  of  testing 
times  are  not  normally  distributed. 


Since  .1077  <  .20,  cannot  reject  null  hypothesis  that  AIS 
testing  times  are  lognormally  distributed. 
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APPENDIX  H4 

KOLMOGOROV-SMIRNOV  GOODNESS-OF-FIT  TEST  OF  THE 
Q-GERT  GENERATED  UNIFORM  DISTRIBUTION 
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KOLMOGOROV-SMIRNOV  GOODNESS-OF-FIT  TEST 

TEST  DISTRIBUTION  -  UNIFORM  (RANGE  =  0.000  to  1.000) 

CASES  *  93  MAX (AES  DIFF)  =  0.0733 

K-S  Z  =  0.707  2-TAILED  P  =  0.699 

n=93;  a=.01 

H  :  VAS  assignments  are  from  uniform  distribution 
in  Q-GERT  simulation. 

H  :  VAS  assignments  are  not  from  uniform  distribu¬ 
tion  in  Q-GERT  simulation. 

Since  .699  >  a (.01),  cannot  reject  that  VAS  assignments 
are  uniformly  distributed. 
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APPENDIX  H5 

HISTOGRAM  OF  EXPONENTIAL  DISTRIBUTION  OF 
INTERARRIVAL  TIMES 
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Because  the  histogram  distribution  appears  exponen¬ 
tial,  and  the  values  of  mean,  median  and  mode  fall  in  that 
order,  the  assumption  that  interarrival  times  are  exponen¬ 
tially  distributed  cannot  be  rejected. 
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APPENDIX  I 


Q-GERT  GENERATED  RESPONSE  SURFACES 


127 
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Appendix  I  is  the  Q-GERT  generated  output  of  the 
simulation  model.  Column  one  shows  the  run  number,  each 
consisting  of  30  days  of  activity.  Column  two  shows  the 
number  of  AIS  test  sets  for  each  run,  while  column  three 
shows  the  node  number  of  the  AIS  queue.  Columns  four, 
five,  and  six  show  the  number  of  LRUs  in  the  AIS  queue, 
and  column  seven  shows  the  average  time  a  LRU  awaits 
maintenance  in  the  queue. 
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Number 

in  Queue 

Waiting 

Time 

Run  # 

#  of  AIS 

Node 

Avg 

Min 

Max 

Avg 

1 

1 

14 

18.4951 

0 

32 

133.1650 

2 

14 

1.2931 

0 

6 

7.8901 

3 

49 

0.1891 

0 

4 

1.2052 

2 

1 

14 

15.3759 

0 

32 

106.4483 

2 

14 

1.2478 

0 

7 

8.1673 

3 

49 

0.2264 

0 

3 

1.4301 

3 

1 

14 

24.1240 

0 

47 

152.3622 

2 

14 

6.2627 

0 

14 

34.1603 

3 

49 

0.1129 

0 

3 

0.7196 

4 

1 

14 

13.1309 

0 

26 

100.5774 

2 

14 

0.7088 

0 

5 

5.2073 

3 

49 

0.0662 

0 

3 

0.4811 

5 

1 

14 

19.1835 

0 

42 

120.1054 

2 

14 

1.3156 

0 

9 

9.1965 

3 

49 

0.1744 

0 

5 

1.1960 

6 

1 

14 

20.1390 

0 

39 

134.2600 

2 

14 

3.1009 

0 

12 

19.9342 

3 

49 

0.0989 

0 

2 

0.7421 

7 

1 

14 

16.5230 

0 

27 

126.5589 

2 

14 

0.6433 

0 

5 

4.6320 

3 

49 

0.2286 

0 

3 

1.5382 

8 

1 

14 

21.0297 

0 

41 

141.5084 

2 

14 

1.2954 

0 

7 

8.4789 

3 

49 

0.1384 

0 

3 

0.9766 

9 

1 

14 

20.9139 

0 

44 

142.0566 

2 

14 

1.2509 

0 

5 

9.0976 

3 

49 

0.1317 

0 

3 

0.9775 

10 

1 

14 

19.5124 

0 

35 

151.0634 

2 

14 

0.4769 

0 

5 

3.3998 

3 

49 

0.1776 

0 

6 

1.3323 

11 

1 

14 

23.3834 

0 

48 

154.4595 

2 

14 

5.5318 

0 

14 

31.1164 

3 

49 

0.4277 

0 

4 

2.5879 

12 

1 

14 

12.4766 

0 

29 

103.2550 

2 

14 

1.1236 

0 

5 

7.4907 

3 

49 

0.2214 

0 

4 

1.3509 
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APPENDIX  J 

ANALYSIS  OF  VARIANCE  OF  RESPONSE  SURFACE 


130 


Appendix  J  is  divided  into  three  parts.  Appen¬ 
dix  J1  is  a  parametric  analysis  of  the  response  surface 
shown  in  Appendix  I  and  was  used  to  determine  if  para¬ 
metric  statistics  could  be  used  to  analyze  the  results. 
Appendix  J2  is  a  nonparametric  test  of  the  response  sur¬ 
face  shown  in  Appendix  I  and  was  used  to  determine  if 
nonparametric  statistics  could  be  used  to  analyze  the 
results.  Appendix  J3  is  the  analysis  of  variance  test 
used  to  determine  if  the  average  LRU  waiting  time  was 
independent  of  the  number  of  AIS  test  sets. 
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APPENDIX  J1 


ANALYSIS  OF  VARIANCE  AND  DUNCAN’S  MULTIPLE  RANGE 
TEST  OF  RESPONSE  SURFACE 


TESTS  FOR  HOMOGENEITY  OF  VARIANCES 


COCHRANS  C  =  MAX  VARIANCE/ SUM  (VARIANCES) 

=  0.7767,  P  =  0.000  (approx) 


BARTLETT-BOX  F 

=  31.803, 

P  =  0.000 

MAXIMUM  VARIANCE /MINIMUM 

=  1282.701 

SUBSET 

1 

GROUP 

3  2 

MULTIPLE  RANGE  TEST 

MEAN 

1.2115  12.3976 

DUNCAN  PROCEDURE 

RANGES  FOR  THE  .01  LEVEL- 

SUBSET 

2 

3.87  4.03 

GROUP 

1 

MEAN 

130.4850 

H  :  Variances  of  average  waiting  time  for  service 
are  equal  for  1,  2,  and  3  servers. 

Ha:  Variances  of  average  waiting  time  for  service 
are  not  equal  for  1,  2,  and  3  servers. 


Since  the  P  values  for  Cochran's  C  and  Bartlett-Box  tests 
are  0.000,  reject  null  hypothesis  that  variances  are  equal. 
Therefore,  ANOVA  cannot  be  used  to  test  the  difference  of 
means . 
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APPENDIX  J2 

KRUSKAL-WALLIS  ANALYSIS  OF  VARIANCE  OF 
RESPONSE  SURFACE 


KRUSKAL-WALLIS  ONE-WAY  ANOVA 


TEST  SET  123 

NUMBER  12  141  12 

MEAN  RANKS  30.50  1.57  6.50 

CASES  =  36  CHI-SQUARE  =  395.034  SIGNIFICANCE  =  0.000 


n  =  36;  a= .  01 

H  :  Distribution  of  waiting  time  for  service  for 
°  one,  two,  and  three  AIS  test  sets  are  equal. 

H  :  Distributions  of  at  least  two  waiting  times 
a  for  service  are  not  equal. 

Since  .000  <  .01,  can  reject  that  all  distributions  are 
equal.  Therefore,  along  with  Duncan's  Multiple  Range 
Test  results  it  appears  as  though  the  distribution  for  one 
AIS  is  not  equal  to  distributions  for  two  and  three  for 
waiting  time  for  service. 


APPENDIX  J3 

ONE-WAY  ANALYSIS  OF  VARIANCE  OF 
RESPONSE  SURFACE 
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ONE-WAY  ANALYSIS  OF  VARIANCE 


GROUP 

COUNT 

MEAN 

STANDARD 

DEVIATION 

GRP01 

12 

130.4850 

19.2839 

GRP  02 

12 

12.3976 

10.3245 

GRP  03 

12 

1.2115 

0.5384 

TOTAL 

36 

48.0314 

60.5668 
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